Position Details: Data Engineer - Migration

Description:

We are looking for a Data Engineer to support ongoing data migration initiatives.

The role requires strong expertise in SQL, along with working knowledge of PySpark and Spark-based processing.

The candidate will be responsible for handling large datasets and ensuring efficient data transformation and movement.

Key Responsibilities
● Work on end-to-end data migration activities
● Write, optimize, and maintain complex SQL queries
● Develop data pipelines using PySpark
● Understand and apply Spark concepts in data processing
● Collaborate with internal teams for data-related requirements
● Perform data validation and ensure data accuracy

Required Skills(mandatory)
● Strong SQL skills
● Hands-on experience with PySpark
● Good understanding of Apache Spark concepts
● Experience working with large-scale data and ETL processes

Preferred Skills
● Exposure to Databricks
● Familiarity with modern data engineering tools and practices

Note
● PySpark expertise at an advanced level is not required; working knowledge is sufficient
● Candidates should be adaptable and open to leveraging new tools for development efficiency

Perform an action: