About the Role :

We are looking for a Senior Data Engineer with strong experience in building scalable data pipelines and data processing solutions.

The ideal candidate should have hands-on expertise in Python, advanced SQL, Spark/PySpark, Airflow, and ETL/ELT processes.

Key Responsibilities :

- Design, develop, and maintain scalable and high-performance data pipelines.

- Build robust ETL/ELT workflows for processing and transforming large datasets.

- Develop data processing solutions using Python and PySpark/Spark.

- Write and optimize complex SQL queries for large-scale data processing.

- Build and manage workflow orchestration using Apache Airflow.

- Ensure data quality, reliability, scalability, and performance across data pipelines.

- Troubleshoot pipeline failures and optimize data processing performance.

- Collaborate with data analysts, data scientists, and engineering teams to deliver data solutions.

Required Skills :

- 5 - 9 years of experience in Data Engineering.

- Strong proficiency in Python.

- Advanced SQL skills.

- Hands-on experience with PySpark / Apache Spark.

- Strong experience with Apache Airflow.

- Expertise in ETL/ELT and data pipeline development.

- Experience working with large-scale data processing environments.

- Strong problem-solving and analytical skills.