Senior Data Engineer Job Number:
J0319-0010 - Full Time Category:
Information Technology Location:
Toronto, Ontario Salary:
Open AddThisShare | Email Favorites LinkedIn Facebook Twitter Senior Data Engineer
Our client is an international financial services organization, dedicated to enabling their customers to thrive and prosper.
They are looking for a Senior Data Engineers to join their Centre of Excellence in Toronto.
We are looking for Data Engineers that will work on the collecting, storing, processing, and analysing of huge sets of data. The primary focus will be on choosing optimal solutions to use for these purposes, then maintaining, implementing, and monitoring them. You will also be responsible for integrating them with the architecture used across the company and to help build out some core services that power Machine Learning and advanced analytics systems.
Title: Senior Data Engineer
Position status: Full time permanent
Salary: Highly competitive + Benefits + Vacation
TO APPLY: Please send your resume to: [email protected]
•Ability to process and rationalize structured data, message data and semi/unstructured data and ability to integrate multiple large data sources and databases into one system
•Proficient understanding of distributed computing principles and of the fundamental design principles behind a scalable application
•4-5 years of experience with strong knowledge of the Big Data eco system, experience with Hortonworks/Cloudera platforms
•Practical experience in using HDFS.
•Practical expertise in developing applications and using querying tools on top of Hive, Spark (PySpark)
•Strong Scala and park skills within a big data environment. Additional experience using ELK stack will be highly regarded.
•Experience in Python, particularly the Anaconda environment and Python based ML model deployment
•Experience of Continuous Integration/Continuous Deployment (Jenkins/Hudson/Ansible)
•Experience with using GIT/GITLAB as a version control system.
•Experience in working in Teams using the Agile Methods ( SCRUM ) and Confluence/JIRA
•Good communication skills (written and spoken), ability to engage with different stakeholders and to synthesize.
Nice to Haves
•Knowledge of at least one Python web framework (preferably: Flask, Tornado, and/or twisted)
•Good understanding of global markets, markets macrostructure and macro economics
•Experience with Google Cloud Platform (Data Proc / Dataflow)
•Managing, training and hiring junior data engineers. Take a lead role within a team.
•Strong experience in developing pipelines in conjunction with data scientists for machine learning solutions (data extraction, processing, feeding models, deploying models, automation)
Votre partenaire en recrutement – Your recruitment partner www.groomassocies.com View Disclaimer Add to favorites Printer-friendly version