Role : Sr.Azure Data Engineer

Job Summary :

We are seeking a highly skilled and experienced Sr. Azure Data Engineer to design, build, and optimize our next-generation data platform on Microsoft Azure.

This role requires 5+ years of dedicated experience with Azure data services, focusing heavily on Azure Synapse Analytics and Azure Data Factory (ADF).

The successful candidate will be a key contributor to developing scalable data ingestion pipelines, transforming complex data sets, and driving advanced analytics capabilities, with crucial expertise or exposure to Microsoft Fabric.

Core Responsibilities :

Azure Data Platform Development :

- Design, build, and maintain highly scalable and reliable ETL/ELT data pipelines using Azure Data Factory (ADF), including orchestration, monitoring, and error handling.

- Implement robust data warehousing solutions and complex analytical queries using Azure Synapse Analytics (SQL Pools, Serverless Pools, Spark Pools).

- Develop, optimize, and troubleshoot large-scale data transformation jobs using PySpark/Spark within the Azure ecosystem.

- Ensure security and governance are maintained across all data solutions deployed on Azure.

Microsoft Fabric and Modernization :

- Apply knowledge and hands-on experience with Microsoft Fabric to evaluate, prototype, and implement unified data solutions (e.g., Lakehouse, Data Engineering components).

- Contribute to the modernization and migration strategy, transitioning legacy data systems to Azure Synapse and the Microsoft Fabric platform.

- Utilize Fabric components for efficient data governance and improved data consumption experiences.

Data Modeling and Performance :

- Design and implement optimal data models (dimensional, transactional) within Azure Synapse to support demanding business intelligence and reporting requirements.

- Performance tune data ingestion processes and query execution within ADF and Synapse to ensure efficient resource utilization and low latency.

- Write and optimize complex SQL queries for data integration and analysis.

DevOps and Quality Engineering :

- Implement CI/CD pipelines using Azure DevOps for automated deployment of ADF and Synapse artifacts.

- Follow established software engineering principles, conduct thorough code reviews, and create comprehensive technical documentation.

Required Skills & Qualifications :

Experience : 5+ years of professional experience as a Data Engineer.

Cloud Platform : Expert proficiency in Microsoft Azure data services.

Core Tools : Deep, hands-on experience with Azure Synapse Analytics and Azure Data Factory (ADF).

Data Technologies : Strong proficiency in SQL and solid understanding of data warehousing concepts.

Fabric Knowledge : Expertise or strong familiarity with the Microsoft Fabric platform is highly required.

Preferred Skills :

- Experience with Azure Databricks and PySpark programming.

- Proficiency in using Azure DevOps for CI/CD implementation.

- Knowledge of Azure Data Lake Storage (ADLS Gen2) architecture and optimization.

- Microsoft Azure Data Engineering certification (e.g., DP-203).

Location & Logistics :

Location : Visakhapatnam, India

Mode : Permanent