Lead Senior Data Engineer at BeachHead
BeachHead Inc. • toronto, Canada
Role Description
Elevate your career as a Senior Data Engineer at BeachHead, working on a major data platform modernization project. Leverage your Databricks expertise to lead data migration efforts for a top financial client.
In this pivotal role, you'll specialize in Databricks and drive large-scale data transitions within Capital Markets. This opportunity allows you to design advanced data ingestion pipelines and develop high-performance Spark/Scala workflows. Collaborating with technical teams, you'll ensure quality and scalability in delivering efficient data frameworks.
Key Responsibilities: • Design and develop batch and real-time data ingestion pipelines • Build and optimize Spark/Scala-based workflows for performance • Implement streaming solutions using Kafka or APIs • Develop medallion architecture with best practices • Ensure data quality through validation and reconciliation
Requirements: • Extensive hands-on experience with Databricks • Advanced proficiency in A...
In this pivotal role, you'll specialize in Databricks and drive large-scale data transitions within Capital Markets. This opportunity allows you to design advanced data ingestion pipelines and develop high-performance Spark/Scala workflows. Collaborating with technical teams, you'll ensure quality and scalability in delivering efficient data frameworks.
Key Responsibilities: • Design and develop batch and real-time data ingestion pipelines • Build and optimize Spark/Scala-based workflows for performance • Implement streaming solutions using Kafka or APIs • Develop medallion architecture with best practices • Ensure data quality through validation and reconciliation
Requirements: • Extensive hands-on experience with Databricks • Advanced proficiency in A...