Job Summary :

We are seeking a skilled Data Engineer with experience in Snowflake, AWS Lakehouse, and Data Structures to join our team and support the migration of enterprise data to an AWS Lakehouse environment. In this role, you will be responsible for designing, developing, and maintaining scalable data pipelines, ensuring high data quality, and validating data throughout the migration process. You will collaborate with cross-functional teams to build reliable, high-performance data solutions that enable analytics and business insights.

Key Responsibilities :

- Design, develop, and optimize scalable ETL/data pipelines.

- Migrate and transform data into the AWS Lakehouse platform.

- Build and maintain data processing workflows using Apache Spark.

- Perform data validation, quality checks, and reconciliation to ensure data accuracy.

- Write efficient SQL queries for data extraction, transformation, and analysis.

- Collaborate with engineering and business teams to understand data requirements and deliver robust solutions.

- Monitor, troubleshoot, and optimize data pipelines for performance and reliability.

- Follow engineering best practices for code quality, testing, and deployment.

Required Skills :

- Strong programming experience in Python or Java.

- Hands-on experience with SQL.

- Experience working with Apache Spark.

- Good knowledge of AWS cloud services.

- Strong understanding of ETL processes and data pipeline development.

Preferred Skills :

- Experience with Snowflake.

- Knowledge of Apache Iceberg.

- Experience with Apache Kafka.

- Familiarity with CI/CD pipelines and Kubernetes.

Qualifications :

- Bachelor's degree in Computer Science, Information Technology, Engineering, or a related field.

- Relevant experience in data engineering, data migration, or big data technologies.

- Strong analytical, problem-solving, and communication skills.