Role Overview :

We are seeking a highly skilled Microsoft Fabric Data Engineer to design, develop, and maintain modern data platforms leveraging Microsoft Fabric. The ideal candidate should have hands-on experience with OneLake, Lakehouse, Data Factory, Data Pipelines, PySpark, SQL, and Medallion Architecture to support enterprise-scale analytics and reporting requirements.

Key Responsibilities :

Data Engineering & Integration :

- Design, develop, and maintain scalable data ingestion and transformation pipelines using Microsoft Fabric.

- Build and manage ETL/ELT workflows using Fabric Data Factory and Data Pipelines.

- Integrate data from multiple sources including databases, APIs, flat files, cloud storage, and SaaS applications.

- Implement incremental data loads and Change Data Capture (CDC) strategies.

Lakehouse Development :

- Design and maintain Fabric Lakehouse environments.

- Develop and optimize Delta Tables for high-performance analytics workloads.

- Implement Medallion Architecture (Bronze, Silver, Gold layers) to support data quality and governance requirements.

- Create curated datasets for reporting, analytics, and AI/ML use cases.

Data Transformation & Processing :

- Develop data transformation logic using PySpark, Spark SQL, and notebooks.

- Create reusable frameworks and data engineering best practices.

- Perform data cleansing, enrichment, and standardization activities.

Data Modeling & Analytics Support :

- Design dimensional and analytical data models.

- Collaborate with Business Intelligence teams to support Power BI semantic models and reporting requirements.

- Ensure data consistency, quality, and accuracy across data platforms.

Performance Optimization & Governance :

- Monitor data pipeline performance and troubleshoot production issues.

- Optimize Spark jobs, Lakehouse storage, and query performance.

- Implement security controls, role-based access, and data governance standards.

- Support data lineage, auditing, and compliance requirements.

DevOps & Collaboration :

- Implement CI/CD processes using Git integration and deployment pipelines.

- Participate in Agile ceremonies and collaborate with architects, analysts, and business stakeholders.

- Maintain technical documentation and operational runbooks.

Required Skills :

Technical Skills :

- Microsoft Fabric

- OneLake

- Fabric Lakehouse

- Fabric Data Factory

- Data Pipelines

- Notebook Development

- PySpark

- Spark SQL

- SQL

- Delta Lake

- Medallion Architecture

- Power BI Integration

- Git Version Control

Cloud & Data Platform Experience :

- Azure Data Services

- Azure Data Lake Storage (ADLS)

- Azure Synapse Analytics (preferred)

- Azure DevOps

Data Engineering Concepts :

- ETL/ELT Development

- Data Modeling

- Data Warehousing

- Data Governance

- Data Quality Frameworks

- Performance Tuning

Preferred Qualifications :

- Experience in large-scale enterprise data transformation programs.

- Knowledge of Data Mesh and Modern Data Platform concepts.

- Exposure to AI/ML data preparation processes.

- Microsoft Fabric Certification (Preferred).

- Experience working in Banking, Insurance, Healthcare, or Retail domains.