Azure Data Engineer

Role & responsibilities :

- Design, develop, and maintain end-to-end data pipelines using Azure Data Factory (ADF)

- Build and optimize data ingestion, transformation, and orchestration workflows from multiple data sources

- Implement modern data architectures using Microsoft Fabric (Lakehouse, Data Warehouse, OneLake)

- Develop and manage data models to support analytics and reporting use cases

- Work with Azure Data Lake Storage (ADLS Gen2), Azure SQL, Synapse, and Fabric Data Warehouse

- Ensure data quality, data validation, and monitoring across pipelines

- Optimize pipeline performance, cost, and reliability

- Implement CI/CD pipelines for data solutions using Azure DevOps or GitHub

- Apply security, governance, and compliance best practices (RBAC, managed identities, encryption)

- Collaborate with BI teams to enable Power BI / Fabric semantic models

- Troubleshoot production issues and provide root cause analysis

- Document data pipelines, architecture, and operational processes

Preferred candidate profile :

- Strong hands-on experience with Microsoft Azure Data Services

- Expertise in Azure Data Factory (ADF) pipelines, triggers, linked services, datasets

- Practical experience with Microsoft Fabric (Lakehouse, Data Engineering, Data Warehouse, Notebooks)

- Proficiency in SQL for data transformation and performance tuning

- Experience with PySpark / Spark SQL in Fabric or Azure Synapse

- Strong understanding of data warehousing concepts (star schema, slowly changing dimensions, ETL/ELT)

- Experience with ADLS Gen2, OneLake, and cloud storage concepts

- Knowledge of CI/CD, Git, and version control

- Familiarity with monitoring and logging in Azure