Senior Big Data Engineer with Spark Expertise
GoTo • québec, Canada
Role Description
Lead big data transformation as a Senior Software Engineer utilizing Spark, Airflow, and Databricks. Drive impactful data solutions and optimize workflows across diverse teams.
This position focuses on addressing complex data processing challenges and ensuring reliable data pipelines. You will collaborate with teams to enhance software release timelines, improve data validation methods, and deliver high-quality software solutions throughout the development cycle.
Key Responsibilities: • Tackle complex data processing challenges • Partner to ensure timely releases of software • Strengthen monitoring and validation protocols • Drive incremental developments and fixes • Collaborate efficiently across different time zones
Requirements: • Hands-on expertise in Spark, Airflow, AWS, and Databricks • Solid programming skills in Python and SQL • Familiarity with big data processing concepts • Experience in debugging and testing frameworks • Knowledge of AI tools like ...
This position focuses on addressing complex data processing challenges and ensuring reliable data pipelines. You will collaborate with teams to enhance software release timelines, improve data validation methods, and deliver high-quality software solutions throughout the development cycle.
Key Responsibilities: • Tackle complex data processing challenges • Partner to ensure timely releases of software • Strengthen monitoring and validation protocols • Drive incremental developments and fixes • Collaborate efficiently across different time zones
Requirements: • Hands-on expertise in Spark, Airflow, AWS, and Databricks • Solid programming skills in Python and SQL • Familiarity with big data processing concepts • Experience in debugging and testing frameworks • Knowledge of AI tools like ...