Azure Data Engineer - PySpark, Databricks, Azure SQL
Astra-North Infoteck Inc. ~ Conquering today’s challenges, achieving tomorrow’s vision! • toronto, Canada
Role Description
- Strong knowledge of Azure services: Data Factory, Databricks, ADLS, Azure SQL.
- Hands-on experience with Databricks notebooks, PySpark, Spark SQL, and Delta Lake.
- Understanding of ETL/ELT concepts, data ingestion patterns, and data warehousing.
- Experience troubleshooting pipeline failures, cluster issues, and performance bottlenecks.
- Familiarity with Azure DevOps, Git version control, and CI/CD pipelines.
- Knowledge of monitoring tools including Azure Monitor, Log Analytics, and Databricks logs.