Job Summary :

We are looking for an experienced Azure Data Engineer with strong Microsoft Fabric expertise to design, develop, and optimize modern data and analytics solutions.

The role requires hands-on experience across Fabric Lakehouse, Warehouse, OneLake, Data Factory, PySpark, Power BI, DAX, semantic models, and Data Agents.

The ideal candidate should be strong in both data engineering and analytics, with a particular focus on performance optimization, scalable data modeling, and AI-enabled data solutions.

Key Responsibilities :

- Design and develop scalable ETL/ELT pipelines using Microsoft Fabric Data Factory, Dataflows Gen2, SQL, Python, and PySpark.

- Build and optimize Lakehouse, Warehouse, OneLake, and Delta Lake solutions using Bronze/Silver/Gold architecture.

- Develop complex T-SQL queries, views, transformations, and dimensional data models using star schema, fact/dimension tables, and SCD.

- Develop and optimize Power BI semantic models, DAX measures, Power Query, and reports.

- Implement and optimize Direct Lake models while minimizing unnecessary DirectQuery fallback.

- Design and maintain Fabric Data Agents and validate AI-generated SQL, PySpark, and DAX using Copilot/Fabric AI capabilities.

- Perform end-to-end performance tuning across Spark/PySpark, SQL Warehouse, Delta tables, Data Factory, Power BI, DAX, and Fabric capacity.

- Optimize Delta tables using appropriate partitioning, OPTIMIZE, VACUUM, and V-Order strategies.

- Monitor workloads using Spark UI, Query Insights, Monitoring Hub, and Capacity Metrics.

- Implement CI/CD using Git/Azure DevOps/GitHub and Fabric deployment pipelines.

- Apply security and governance using Microsoft Entra ID, workspace roles, OneLake security, and Microsoft Purview.

- Collaborate with analysts, BI developers, data scientists, and business stakeholders to deliver production-ready data solutions.

Required Skills :

- 4+ years of experience in Azure Data Engineering.

- Strong hands-on experience with Microsoft Fabric.

- Advanced SQL/T-SQL skills.

- Strong Python and PySpark experience.

- Strong knowledge of Lakehouse, Warehouse, OneLake, Delta Lake, and Medallion Architecture.

- Strong Power BI, DAX, semantic modeling, and Power Query skills.

- Experience with Direct Lake and Power BI performance optimization.

- Experience with Data Factory and Dataflows Gen2.

- Strong understanding of data modeling and performance tuning.

- Experience with Git, CI/CD, and deployment pipelines.

- Understanding of data security, governance, and monitoring.

Good to Have :

- Hands-on experience building Microsoft Fabric Data Agents.

- Experience with Copilot, Azure OpenAI, MLflow, or MLOps.

- Knowledge of Microsoft Purview.

- Experience with Real-Time Intelligence, Eventstreams, Eventhouse, or KQL.

- Experience with Azure SQL, Snowflake, S3, or other external data sources.

- Microsoft Fabric/Azure Data Engineering certification.

Education :

Bachelor's degree in Computer Science, Information Technology, Data Engineering, or a related field