Role Overview :

We are looking for an experienced Data Engineer to design, develop, and maintain scalable data platforms and enterprise data pipelines in cloud environments.

Key Responsibilities :

- Design and develop scalable ETL/ELT data pipelines.

- Build and optimize data solutions using Python, SQL, Spark, and Databricks.

- Develop data workflows using Azure Data Factory, Azure Synapse, and Databricks.

- Integrate data from multiple enterprise applications and operational systems.

- Implement data models, data quality, governance, and metadata management.

- Work with both batch and near real-time data processing architectures.

- Optimize data pipelines for performance, reliability, and scalability.

- Collaborate with data scientists, analysts, application teams, and business stakeholders.

Required Skills :

- 5+ years of experience in Data Engineering and large-scale data platforms.

- Strong hands-on experience with Python, SQL, Spark, and Databricks.

- Strong knowledge of ETL/ELT and distributed data processing.

- Experience with Azure Data Factory, Synapse, or equivalent cloud data services.

- Good understanding of data modeling, data governance, data quality, and metadata.

- Experience working with cloud data platforms and data storage ecosystems.

- Knowledge of batch and real-time data architectures.

- Exposure to GitHub/Git-based version control and CI/CD is preferred.

Preferred :

- Experience with Azure Kubernetes Service (AKS).

- Experience integrating AI/ML workloads with enterprise data platforms.

- Strong problem-solving and communication skills.