Senior DevOps Engineer with Hadoop Administration Senior DevOps Engineer with Hadoop Administration …

TD Bank Group
à Toronto, ON, Canada
CDI, Plein-temps
Soyez parmi les premiers à postuler
TD Bank Group
à Toronto, ON, Canada
CDI, Plein-temps
Soyez parmi les premiers à postuler
Senior DevOps Engineer with Hadoop Administration
Company Overview

Tell us your story. Don't go unnoticed. Explain why you're a winning candidate. Think "TD" if you crave meaningful work and embrace change like we do. We are a trusted North American leader that cares about people and inspires them to grow and move forward.

Stay current and competitive. Carve out a career for yourself. Grow with us. Here's our story:

Department Overview

The Treasury Analytics Group is responsible for measurement and management of market risk (interest rate and foreign exchange) for the Bank's retail portfolios. The team develops financial models and processes required for measuring, transfer pricing, hedging product profitability, and financial management reporting.

The Treasury Analytics Group is embarking on a brand new initiative to build the next generation strategic platform for risk, valuations and analytics to meet the growing and future needs of the department. This is an exciting opportunity to work on Cloud Integration (Azure) as well as cutting edge technologies including Big Data and NoSQL databases (Hadoop Ecosystem: Hbase, Hive, SPARK, and MongoDB) to allow the business to gain advanced insight into their portfolios and valuation metrics.

Job Description

About the Role

  • Setup, maintain, upgrade and enhance the Hadoop, HBase and other components such as HDFS, YARN, Zookeeper, Hive, Spark2

  • Setup and maintain HBase replication between datacenters

  • Support and maintain Hadoop clusters in all environments

  • Troubleshoot any issue in Hadoop, HBase, Spark, Yarn

  • Capacity planning, cluster deigning and deployment, system and job troubleshooting, cluster performance tuning



  • Five or more years of Hadoop, HBase and yarn experience with deep knowledge

  • Strong working experience with large Hadoop/HBase clusters: setup, migration, upgrading and scaling up

  • Strong working experience with HBase replication and disaster recovery

  • Strong working experience with yarn and yarn scheduler

  • Good troubleshooting skills, understanding of system's capacity, bottlenecks, basics of memory, CPU, OS, storage and networks

  • Proven track record with troubleshooting with YARN jobs, HBase replication, Hadoop cluster, zookeeper and other Hadoop issues.

  • Working experience with Linux/Unix OS

  • Scripting knowledge (Python/Perl/Shell) to automate tasks

  • Nice to have Java development knowledge or experience

  • Nice to have working experience of automation tools such as Salt, Ansible

  • Nice to have CI/CD pipeline experience with Jenkins, Git, BitBucket and Gradle

  • Strong verbal and written communication skills

Additional Information

Join in on what others in TD Technology Solutions are doing:
  • Inspire a positive work environment and help champion quality, innovation, teamwork and service to the business.
  • Learn voraciously, stretch your thinking,




At TD, we are committed to fostering an inclusive, accessible environment, where all employees and customers feel valued, respected and supported. We are dedicated to building a workforce that reflects the diversity of our customers and communities in which we live and serve. If you require an accommodation for the recruitment/interview process (including alternate formats of materials, or accessible meeting rooms or other accommodation), please let us know and we will work with you to meet your needs.