Synapse XTL - Data Engineer - Azure Data Factory

We are looking for an experienced Data Engineering professional with strong expertise in building scalable data platforms and enterprise ETL/ELT pipelines. The ideal candidate should have hands-on experience with SQL, Python, Spark, Databricks, and Azure data services, along with strong knowledge of data modeling, governance, and quality. Experience integrating data from multiple systems and working with both batch and near-real-time architectures is highly desirable.

Experience : 5+ years

Location : India/Remote

Key Skills :

- AI/ML

- SQL

- Cloud data platforms

- Data storage ecosystem

- ETL

- Azure Kubernetes, Azure Databricks, GitHub

Required Skillset :

- 5+ years of experience in Data Engineering and large-scale data platform development.

- Strong proficiency in SQL, Python, Spark, Databricks, and distributed data processing platforms.

- Experience designing and implementing enterprise ETL/ELT pipelines.

- Experience with Azure Data Factory, Synapse, Databricks, or equivalent cloud data services.

- Strong knowledge of data modeling, data governance, data quality, and metadata management.

- Experience integrating data from multiple applications and operational systems.

- Understanding of both batch and near real-time data architectures.

Key Responsibilities :

- Architect and maintain scalable ETL/ELT pipelines to ensure high-quality data availability for downstream AI/ML models.

- Design and implement comprehensive data models that support complex analytical requirements and business reporting needs.

- Manage and optimize Azure Databricks clusters to ensure cost-effective and high-performance data processing.

- Orchestrate containerized workloads using Azure Kubernetes Service to maintain consistent deployment environments.

- Establish and enforce data governance and metadata management frameworks to ensure data lineage, security, and compliance.