Lead Data Architect at Databricks
VDart Inc • mississauga, Canada
Role Description
Shape the future of data architecture with a hands-on Lead Data Architect at Databricks in Mississauga, ON. Drive Databricks workstream and modernize enterprise data platforms.
This senior role invites you to lead a significant data modernization program for a large Canadian retail client. You'll be responsible for end-to-end Databricks solutions including architecture, Lakehouse design, and migration of legacy ETL workloads. Collaborating closely with the client’s senior leadership, you'll transition their on-premise estate to an Azure-native platform for enhanced analytics and AI capabilities.
Key Responsibilities:
• Architect scalable Databricks Lakehouse solutions on Azure
• Build and review PySpark/Spark SQL pipelines and orchestrations
• Drive legacy ETL workloads conversion to Databricks
• Optimize cluster configurations and manage costs
• Implement data governance through Unity Catalog
Requirements:
• 12+ years in data engineering with 4+ years in Dat...
This senior role invites you to lead a significant data modernization program for a large Canadian retail client. You'll be responsible for end-to-end Databricks solutions including architecture, Lakehouse design, and migration of legacy ETL workloads. Collaborating closely with the client’s senior leadership, you'll transition their on-premise estate to an Azure-native platform for enhanced analytics and AI capabilities.
Key Responsibilities:
• Architect scalable Databricks Lakehouse solutions on Azure
• Build and review PySpark/Spark SQL pipelines and orchestrations
• Drive legacy ETL workloads conversion to Databricks
• Optimize cluster configurations and manage costs
• Implement data governance through Unity Catalog
Requirements:
• 12+ years in data engineering with 4+ years in Dat...