Senior Data Engineer - Big Data Innovations
Rivian and Volkswagen Group Technologies • vancouver, Canada
Role Description
Propel your career with Rivian as a Senior Data Engineer in the Data & AI Platform team, focusing on innovative big data solutions. Drive the evolution of our vehicle data processing framework at petabyte scale.
As a vital team member, you will oversee the development and maintenance of a Go-powered data processing framework. Your role includes enhancing Databricks integration, managing CI/CD processes on Kubernetes, and continuously improving framework performance. Engage in collaborative efforts to deploy reliable and scalable data solutions.
Key Responsibilities:
• Architect and enhance Go-based vehicle data processing framework
• Ensure successful Databricks integration for seamless performance
• Oversee CI/CD pipelines for systematic deployments
• Continuously enhance system performance and efficiency
• Quickly troubleshoot and resolve data system issues
Requirements:
• Bachelor’s or Master’s in Computer Sc...
As a vital team member, you will oversee the development and maintenance of a Go-powered data processing framework. Your role includes enhancing Databricks integration, managing CI/CD processes on Kubernetes, and continuously improving framework performance. Engage in collaborative efforts to deploy reliable and scalable data solutions.
Key Responsibilities:
• Architect and enhance Go-based vehicle data processing framework
• Ensure successful Databricks integration for seamless performance
• Oversee CI/CD pipelines for systematic deployments
• Continuously enhance system performance and efficiency
• Quickly troubleshoot and resolve data system issues
Requirements:
• Bachelor’s or Master’s in Computer Sc...