Software Engineer - Big Data Platform

  • Competitive
  • New York, NY, États-Unis
  • CDI, Plein-temps
  • IHS Markit
  • 11 déc. 18

Software Engineer - Big Data Platform

Position Summary
As part of the Data Lake Operations team, the candidate will partner with the Product team and individual Business Lines to understand data onboarding requirements and implement the necessary "Big Data" ETL to onboard data at scale.
Responsibilities

  • Design, plan, develop, deploy and maintain working software in a fast-paced environment using agile methods and iterative delivery of business value
  • Use and exploit the latest "Big Data" development technologies and frameworks to produce and deploy software
  • Participate in the design, planning and development of solutions based on business requirements
  • Participate as part of a project team to design, code, unit test and implement moderately complex programs to support the portfolio management process
  • Monitor and report to management on project status, identify issues that may impede attainment of goals, recommend and implement corrective measures
  • Review and fix problems uncovered by testing or customer feedback
  • Ensure that the system design is aligned with the business requirements through appropriate documentation and requirements mapping
Education/Experience Requirements
  • BS in Computer Science or Engineering with at least 2 years of professional software work experience
  • 2+ years of experience in "Big Data Platform" technologies especially Spark
  • Working knowledge of Amazon cloud technologies (EC2, RedShift, S3, Lambda etc.)
  • Working knowledge of languages such as Python, SQL and C#
  • Knowledge of database technologies such as RedShift and Microsoft SQL Server
  • Strong collaboration and teamwork skills
  • Self-starter and motivated with ability to work in a fast-paced software development environment
  • Strong communication skills
  • Agile experience highly desirable

Organizational Relationships
  • Report directly to Director of Development
  • Interact with other colleagues at all levels to conduct of day-to-day activities
It is the policy of IHS Markit to provide equal employment opportunity (EEO) to all persons regardless of age, color, national origin, citizenship status, physical or mental disability, race, religion, creed, gender, sex, sexual orientation, gender identity and/or expression, genetic information, marital status, status with regard to public assistance, veteran status, or any other characteristic protected by federal, state or local law. In addition, IHS Markit will provide reasonable accommodations for qualified individuals with disabilities. We maintain a drug-free workplace. For candidates in the US, we are a participant in E-Verify (see link below).

EEO is the Law
EEO is the Law Supplement
Right to Work
Pay Transparency Policy
E-Verify

Current Colleagues If you are currently a colleague with IHS Markit please apply internally via Workday.