Lead Data Engineer At Upshop Mississauga

Join Upshop as a Lead Data Engineer and spearhead the evolution of our Databricks Lakehouse. This leadership role requires expertise in data architecture and systems design to enhance retail analytics.

In this pivotal position, you will oversee the architecture and scalability of our data products, ensuring high-quality, actionable insights for food retailers. You will lead the design and optimization of our Databricks Lakehouse and manage multi-tenant ingestion strategies from various data sources. Collaboration is key as you work with BI, Data Science, and Product teams to deliver scalable data solutions.

Key Responsibilities

• Own the end-to-end design of Databricks Lakehouse architecture
• Drive ingestion strategies from Azure and APIs
• Lead development of PySpark-based ETL frameworks
• Implement robust data validation and observability practices
• Oversee CI/CD pipelines and maintain deployment integrity

R...