Senior Java/Spark developer

  • DOE
  • Warren Township, NJ, États-Unis
  • Intérim, Plein-temps
  • IRIS Software, Inc.
  • 08 sept. 17

Need a strong Developer with expertise in Core Java and Spark

Iris's Direct Client, one of the largest Investment Bank is looking to hire a Senior Java Spark developer for a longterm contract opportunity

Position: Senior Java Spark Developer

Job Description:

Consulting position to lead Frameworks development for building enterprise data processing platform. 

Skills: 

Very Strong experience and knowledge of Core Java, Enterprise Java, Apache open source frameworks and Spring framework / Springboot

  • Strong concepts of HTTP & HTTPS
  • Data Structures: Arrays, Lists, Queues, Heaps, Stacks, Trees, Graphs.
  • Algorithms: Sorting, Searching, Hashing, Parsing, divide-and-conquer, dynamic programming, greedy algorithms, graph algorithms, shortest paths algorithms.
  • Extensible hashing, B+Trees, R+Trees. Cache Management Strategies.
  • Strong knowledge of Relational databases and no-sql databases. Hands-on knowledge of MongoDB
  • Parallel Processing Architectures. Parallel Processes Synchronization and Communication.
  • Strong knowledge of Security,  Encryption algorithms (public and private key cryptography)
  • SQL Concepts: SQL Statements: Parsing, Transformation, Optimization and Execution.  Access Paths, Join Types and Join Algorithms, Aggregation Algorithms, Aggregation Functions, Analytic Functions.
  • Transactions: Definition and Properties: Atomicity, Consistency, Isolation, and Durability. Isolation Levels. Locking Strategies.
  • Distributed Databases. Distributed Processing and Distributed Transactions. Two Phase Commit. Data Replication Architectures.
  • ETL Platforms: concepts, methodologies, processes, architectures and technologies.
  • Apache Spark, Yarn, Map Reduce Architecture.
  • Scheduling and Resource Management Algorithms
  • Compiler Construction, Parsing & Interpretation, Code generation.
  • Declarative Data Processing engine. Declarative Data Processing Languages and their translation to MapReduce or SQL.
  • Experienced hands-on software architect with exposure on both application and data architecture.
  • Demonstrated innovative thought process to solving problems.
  • Any knowledge of ExtJS,  JavaScript, HTML, CSS, HTTP will be a huge plus

Tasks:

 Development of common platform using complete custom build or assembly of third party software.

·         Build highly scalable Web application that can be used by thousands of users

·         Build declarative data processing platform/engine that can translate business friendly rules into Apache Spark source code.

·         Build Data Acquisition, Data Quality, Data Processing, Data distribution tool using Apache Spark framework for Big Data based on rules defined by users.

·         Build solution to support TTS DQ Scaling project, BCBS Warehouse project, Data Strategy 2020 projects, RegInsight EAP2.0 projects.

Iris's Direct Client, one of the largest Investment Bank is looking to hire a Senior Java Spark developer for a longterm contract opportunity

Position: Senior Java Spark Developer

 

Job Description:

 

Consulting position to lead Frameworks development for building enterprise data processing platform. 

 

Skills: 

·         Very Strong experience and knowledge of Core Java, Enterprise Java, Apache open source frameworks and Spring framework / Springboot

  • Strong concepts of HTTP & HTTPS
  • Data Structures: Arrays, Lists, Queues, Heaps, Stacks, Trees, Graphs.
  • Algorithms: Sorting, Searching, Hashing, Parsing, divide-and-conquer, dynamic programming, greedy algorithms, graph algorithms, shortest paths algorithms.
  • Extensible hashing, B+Trees, R+Trees. Cache Management Strategies.
  • Strong knowledge of Relational databases and no-sql databases. Hands-on knowledge of MongoDB
  • Parallel Processing Architectures. Parallel Processes Synchronization and Communication.
  • Strong knowledge of Security,  Encryption algorithms (public and private key cryptography)
  • SQL Concepts: SQL Statements: Parsing, Transformation, Optimization and Execution.  Access Paths, Join Types and Join Algorithms, Aggregation Algorithms, Aggregation Functions, Analytic Functions.
  • Transactions: Definition and Properties: Atomicity, Consistency, Isolation, and Durability. Isolation Levels. Locking Strategies.
  • Distributed Databases. Distributed Processing and Distributed Transactions. Two Phase Commit. Data Replication Architectures.
  • ETL Platforms: concepts, methodologies, processes, architectures and technologies.
  • Apache Spark, Yarn, Map Reduce Architecture.
  • Scheduling and Resource Management Algorithms
  • Compiler Construction, Parsing & Interpretation, Code generation.
  • Declarative Data Processing engine. Declarative Data Processing Languages and their translation to MapReduce or SQL.
  • Experienced hands-on software architect with exposure on both application and data architecture.
  • Demonstrated innovative thought process to solving problems.
  • Any knowledge of ExtJS,  JavaScript, HTML, CSS, HTTP will be a huge plus

Tasks:

 Development of common platform using complete custom build or assembly of third party software.

·         Build highly scalable Web application that can be used by thousands of users

·         Build declarative data processing platform/engine that can translate business friendly rules into Apache Spark source code.

·         Build Data Acquisition, Data Quality, Data Processing, Data distribution tool using Apache Spark framework for Big Data based on rules defined by users.

·         Build solution to support TTS DQ Scaling project, BCBS Warehouse project, Data Strategy 2020 projects, RegInsight EAP2.0 projects.