Job Title : Senior Azure Data Engineer - Microsoft Fabric & Databricks

Experience : 6-10 Years

Location : Gurgaon (5 Days Onsite)

Job Summary :

We are seeking an experienced Azure Data Engineer with expertise in Databricks, PySpark, Microsoft Fabric, and Azure Data Services to design, develop, and optimize enterprise-scale data platforms. The role involves building end-to-end data pipelines, integrating SAP data sources, implementing scalable data architectures, and enabling analytics through Microsoft Fabric.

Key Responsibilities :

- Design and develop scalable ETL/ELT pipelines using Azure Data Factory and Microsoft Fabric.

- Build and optimize data ingestion, transformation, and orchestration workflows using Databricks and PySpark.

- Integrate enterprise data sources, including SAP systems, into Microsoft Fabric Lakehouse and Data Warehouse.

- Develop and maintain data models for analytics and reporting requirements.

- Implement monitoring, logging, data quality, and performance optimization frameworks.

- Collaborate with business, analytics, and application teams to deliver reliable data solutions.

- Support CI/CD, deployment automation, and data governance initiatives.

Required Skills :

- 4+ years of hands-on Azure Data Engineering experience.

- Strong expertise in Azure Databricks, PySpark, and Python.

- Experience with Azure Data Factory and Azure Data Lake Storage (ADLS Gen2).

- Hands-on experience with Microsoft Fabric (Lakehouse, Warehouse, Data Pipelines).

- Strong SQL and data modeling skills.

- Experience designing scalable and production-grade data pipelines.

Preferred Skills :

- SAP data integration and understanding of SAP data structures.

- Unity Catalog implementation and governance experience.

- Delta Lake and Spark-based processing.

- Azure DevOps and CI/CD pipelines.

- Power BI integration and reporting support.

- Experience with real-time or near real-time data ingestion.

- Knowledge of data governance and security best practices.

- Azure DP-203 and/or Microsoft Fabric certification.

Education :

- Bachelors or Masters degree in Computer Science, Engineering, Information Technology, or related field.