Key Responsibilities :

- Design, develop, and maintain scalable, reliable, and high-performance data pipelines.

- Build and optimize ETL/ELT workflows for structured and unstructured data processing.

- Develop and maintain data integration solutions between internal and external data sources.

- Design and implement robust data models to support analytics and reporting requirements.

- Build and optimize large-scale data processing workflows using Apache Spark.

- Develop workflow orchestration solutions using Apache Airflow.

- Implement data quality checks, monitoring frameworks, and alerting mechanisms.

- Optimize data pipeline performance, reliability, and scalability.

- Collaborate with Data Scientists, Analysts, and Business stakeholders to understand data requirements.

- Troubleshoot and resolve data platform issues and performance bottlenecks.

- Participate in code reviews and contribute to technical documentation and engineering best practices.

- Ensure adherence to data governance, security, and compliance standards.

Required Skills & Qualifications :

- 6-10 years of experience in Data Engineering.

- Strong proficiency in SQL and Data Modeling.

- Hands-on experience with Python and/or Java.

- Strong experience with Apache Spark for large-scale data processing.

- Experience with Apache Airflow for workflow orchestration and scheduling.

- Expertise in designing and building ETL/ELT pipelines.

- Experience with modern cloud data platforms such as Databricks and/or Snowflake.

- Hands-on experience with at least one major cloud platform :

1. AWS

2. GCP

3. Azure

- Strong understanding of data warehousing concepts and architecture.

- Experience working with distributed data systems and large datasets.

- Strong analytical, debugging, and problem-solving skills.

Preferred Qualifications :

- Databricks Certification and/or Snowflake Certification.

- Experience with real-time or streaming data pipelines.

- Exposure to data lake and lakehouse architectures.

- Familiarity with CI/CD practices and Infrastructure as Code.

- Experience working in Agile development environments.

Preferred Candidate Profile :

- Strong ownership mindset and attention to detail.

- Excellent communication and stakeholder management skills.

- Ability to work independently and collaboratively within cross-functional teams.

- Passion for building scalable and efficient data solutions.

- Continuous learner with interest in modern data engineering technologies.