Senior Big Data Developer

  • Negotiable
  • Londres, Angleterre, Royaume-Uni Londres Angleterre GB
  • CDI, Plein-temps
  • BGC Partners
  • 18 sept. 18 2018-09-18

This is a senior development role working in the team responsible for the firm's Big Data analytics platform, with a specialism in Java or Scala required. The successful candidate will work with the data team to build out the existing platform to support additional technology and business use-cases. The platform delivers data solutions across BGC Group including use-cases for: market data analytics, regulatory reporting, surveillance and revenue analysis.


Key responsibilities:

  • To work in partnership with the business/business analysts to identify key requirements for implementation
  • To identify any technical requirements for new products
  • To work with all the business and technology departments to ensure all business and technical requirements are met
  • To identify and manage any integration work
  • To analyse, design and build any such projects
  • To provide input into the current and on-going system architecture
  • To liaise with other development teams as necessary to implement cross-team projects
  • Be alert to Conduct Risk issues, specifically the risk of harm to client interests, market integrity and/or competition in financial markets due to inappropriate practices or behaviours across the firm

To undertake and manage:

  • Systems analysis and design
  • Systems development
  • Systems documentation
  • Production support and out-of-hours system maintenance

Skills / experience required:

  • Development experience working with Big Data platforms covering the following technologies:
  • Hortonworks, Hive
  • Kafka, KafkaConnect, KafkaStreaming + ZooKeeper
  • Spark, SparkSQL
  • Zeppelin
  • Cassandra
  • ElasticSearch, LogStash, Kibana
  • Linux, Docker, Java or Scala (with Python beneficial)
  • Substantial database experience: Relational and NoSQL data modelling.
  • Jenkins, Ambari, Ansible, Yarn

Additional Skills / experience:

  • AWS: Data Pipeline, S3, EMR, Lamda, DynamoDB, RedShift
  • Datastax
  • Experienced in addressing efficient data storage and querying against very large stores.
  • Experience of accommodating key requirements of MIFID II in designs/implementations.
  • Recent experience using high performance messaging middleware such as Tibco RV or Solace.
  • Experience of software development in a financial services environment advantageous
  • Willingness to keep up to date with latest technology trends and proactively identify appropriate areas into which they can be applied
  • Solid Computing Degree

Personal attributes:

  • Team player with excellent inter-personal skills and confident communication skills.
  • Able to effectively disseminate knowledge and experience to less experienced team members.
  • Must be able to deal with our customers effectively, ie development teams working across the globe using Messaging and Data products, alongside external vendors who use the products.
  • Must be able to deal with and adapt to change extremely effectively.
  • Must be proactive in generating ideas and effective at developing solutions that are balanced, proportionate and effective. It is critical that this is achieved in collaboration with the global team.
  • Ability to work and function under pressure, handle multiple tasks, and shifting priorities
  • "Self-starter" always looking to improve quality of process and deliverables and keen to take a lead role in that process