Job Description :

We are looking for an Azure Data Engineer with strong hands-on experience in building scalable data pipelines and ETL solutions on Microsoft Azure. The ideal candidate should be comfortable working with large datasets, cloud-native services, and modern data engineering frameworks, with a strong focus on Databricks, Azure Data Factory, PySpark, SQL, and Python.

You'll work closely with data scientists, analysts, and business stakeholders to deliver reliable, high-performance data solutions. In short: if data pipelines are your playground, this role is for you.

Key Responsibilities :

- Design, develop, and maintain end-to-end ETL/ELT pipelines on Azure

- Build and optimize data pipelines using Azure Data Factory (ADF)

- Develop scalable data processing solutions using Azure Databricks

- Write efficient PySpark code for large-scale data transformations

- Use Python for data processing, automation, and orchestration

- Develop and optimize SQL queries for analytics and reporting use cases

- Ingest data from multiple sources (APIs, databases, files, streaming sources)

- Implement data quality checks, logging, and monitoring

- Collaborate with cross-functional teams to understand data requirements

- Ensure best practices for performance, security, and cost optimization in Azure

Required Skills & Qualifications :

- Strong experience as a Data Engineer on Azure

- Hands-on expertise in :

1. Azure Databricks

2. Azure Data Factory (ADF)

3. PySpark

4. Python

5. SQL

- Solid understanding of ETL concepts, data modeling, and data warehousing

- Experience working with structured and semi-structured data

- Knowledge of performance tuning and optimization techniques in Spark

- Familiarity with version control tools (Git)

Good to Have (Nice-to-Have Skills) :

- Experience with Delta Lake

- Exposure to Azure Synapse Analytics

- Understanding of CI/CD pipelines in Azure

- Experience with streaming data (Event Hub, Kafka, etc.)

- Knowledge of data governance and security concepts