We are seeking a highly experienced Senior Azure Data Engineer to join our team on a contract basis.

This role requires 8+ years of hands-on expertise in designing, building, and optimizing scalable, cloud-native data platforms within Microsoft Azure.

The successful candidate will be the technical lead for developing robust ELT/ETL pipelines, leveraging Azure Data Factory (ADF), Azure Databricks (PySpark), and ADLS Gen2 to support critical business reporting and analytics.

Role Requirements & Logistics :

Role Title : Senior Azure Data Engineer

Experience Required : 8+ years

Location : Remote (India)

Job Type : Contract

Key Responsibilities & Technical Deliverables :

Data Platform Design & Pipeline Engineering :

- Pipeline Development : Design, develop, and maintain high-volume, resilient ELT/ETL data pipelines using native Azure services, primarily Azure Data Factory (ADF) and/or Azure Synapse Pipelines.

- Big Data Processing : Lead big-data processing initiatives, implementing a schema-on-read approach utilizing ADLS Gen2 (Azure Data Lake Storage Gen2) and Azure Databricks with PySpark for scalable data transformations.

- Data Modeling : Apply deep knowledge of data modelling techniques to ensure data structures are optimized for performance, cost efficiency, and consumption.

Performance, Optimization & Orchestration :

- Optimization : Optimize performance, cost, and reliability across complex data models, data lake storage patterns, and processing workflows to meet service level objectives (SLOs).

- Orchestration : Implement and manage robust data orchestration patterns to schedule, monitor, and manage pipeline dependencies.

- Reporting Enablement : Partner closely with analytics teams and business intelligence users to enable reporting and provide optimized data sources for tools like Power BI or Tableau.

Engineering Excellence & Cloud Integration :

- CI/CD Integration (Preferred) : Experience implementing CI/CD practices for data pipelines, integrating development and deployment processes within Azure DevOps or similar toolchains.

- Advanced SQL : Utilize Advanced SQL capabilities for complex data manipulation, stored procedures, and query tuning within Azure Synapse or related databases.

Required Skills & Expertise :

- Experience : 8+ years of professional experience in data engineering/cloud development.

- Core Languages : Advanced SQL and Python (specifically PySpark required for Databricks).

- Azure ETL/Orchestration (Mandatory) : Expertise in Azure Data Factory (ADF) and data orchestration patterns.

- Azure Big Data (Mandatory) : Mandatory, hands-on experience with Azure Databricks (PySpark) and ADLS Gen2.

- Data Structure : Strong knowledge of data modelling principles and data warehousing concepts.

Preferred / Nice to Have :

- Prior experience with Azure Synapse Analytics is a significant advantage.

- Experience with front-end reporting languages like DAX/Power BI.

- Experience implementing CI/CD for data pipelines