Description :

Role Overview :

We are looking for a skilled Azure Data Engineer to design, develop, and maintain scalable data solutions on Microsoft Azure. The role involves building end-to-end data pipelines, optimizing data processing workflows, and ensuring high data quality and performance. The candidate will work closely with data architects, analysts, and business stakeholders in an Agile environment.

Key Responsibilities :

- Design, develop, and maintain ETL/ELT data pipelines using Azure services.

- Implement data ingestion and transformation using Azure Data Factory, Azure Databricks, and PySpark.

- Build and optimize data solutions using Azure Data Lake Storage (ADLS).

- Develop and manage data models and analytics solutions using Azure Synapse Analytics.

- Ensure data quality, reliability, performance, and security.

- Implement Delta Lake and manage metadata using Unity Catalog.

- Collaborate with cross-functional teams to deliver data solutions on time.

- Monitor, troubleshoot, and optimize data pipelines and workflows.

- Follow Agile/Scrum methodologies and participate in sprint ceremonies.

- Implement CI/CD for data pipelines where applicable.

Required Skills & Qualifications :

- Strong experience as an Azure Data Engineer or similar role.

- Hands-on experience with Azure Databricks, PySpark, and Python.

- Strong experience with Azure Data Factory (ADF).

- Good understanding of Azure Synapse Analytics.

- Experience with SQL and performance optimization.

- Knowledge of data warehousing concepts, ETL/ELT, and data modeling.

- Experience working in Agile/Scrum environments.

Good to Have :

- Experience with Kafka / Event Hubs for streaming data.

- Knowledge of Unity Catalog, Delta Lake, and data governance.

- Azure certifications such as AZ-900, DP-900, DP-203.

- Experience in domains like Banking, Retail, Healthcare, or Finance.