Data Engineer Role: Python & Pyspark Focus
Veriipro • mississauga, Canada
Role Description
Harness your skills in Python and Pyspark as a Data Engineer. This role emphasizes your experience in software solutions and backend services to streamline data operations.
We are looking for someone with 8+ years of relevant experience, who excels in Python and Spark. Your primary tasks will include developing Pyspark applications for data analysis and creating custom frameworks. You'll also work on backend service development while ensuring high standards for performance and security.
Key Responsibilities:
• Design and maintain effective software solutions
• Create Pyspark programs for intuitive data analysis
• Develop Python scripts for HBase data retrieval
• Build and integrate backend services and APIs
• Ensure applications are optimized for performance
Requirements:
• 8 or more years in data engineering roles
• Proficient in both Python and Spark
• Strong experience with Pyspark and DataFrames<...
We are looking for someone with 8+ years of relevant experience, who excels in Python and Spark. Your primary tasks will include developing Pyspark applications for data analysis and creating custom frameworks. You'll also work on backend service development while ensuring high standards for performance and security.
Key Responsibilities:
• Design and maintain effective software solutions
• Create Pyspark programs for intuitive data analysis
• Develop Python scripts for HBase data retrieval
• Build and integrate backend services and APIs
• Ensure applications are optimized for performance
Requirements:
• 8 or more years in data engineering roles
• Proficient in both Python and Spark
• Strong experience with Pyspark and DataFrames<...