About the Role :

We are seeking a skilled Senior Azure Data Engineer with deep expertise in ETL processes and Azure Synapse Analytics to design, develop, and maintain scalable data solutions on Microsoft Azure.

You will play a crucial role in architecting data pipelines, enabling data-driven decision-making, and collaborating with analytics and business teams to support enterprise data initiatives.

Key Responsibilities :

- Design, develop, and optimize robust ETL pipelines using Azure Data Factory, Azure Synapse Analytics, and other Azure data services.

- Architect and implement data ingestion, transformation, and loading workflows to support analytics and reporting needs.

- Develop scalable and high-performance data solutions using Azure Synapse SQL pools, serverless SQL, and Apache Spark pools.

- Work closely with data architects, data scientists, and business stakeholders to translate business requirements into technical solutions.

- Ensure data quality, consistency, and governance across various data sources and platforms.

- Monitor and troubleshoot ETL processes and data pipelines to ensure smooth and efficient operations.

- Implement best practices for data security, compliance, and privacy within Azure environments.

- Optimize storage and query performance for large-scale datasets in Azure Synapse.

- Collaborate with DevOps teams to automate deployments and monitor data infrastructure.

- Mentor junior engineers and promote knowledge sharing within the team.

Required Skills & Qualifications :

- Strong hands-on experience with Azure Data Factory (ADF) for building ETL pipelines.

- Expertise in Azure Synapse Analytics, including SQL pools (dedicated and serverless) and Apache Spark.

- Proficiency in SQL and T-SQL for data querying and transformation.

- Experience with Data Lake Storage Gen2, Blob Storage, and managing large-scale data lakes.

- Familiarity with Power BI or other BI tools is a plus.

- Solid understanding of data modeling, data warehousing concepts, and dimensional modeling.

- Knowledge of programming/scripting languages such as Python, Scala, or .NET for data processing tasks.

- Experience with CI/CD pipelines and Infrastructure as Code (IaC) in Azure (e.g., ARM templates, Terraform).

- Strong problem-solving skills and the ability to work in a fast-paced agile environment.

- Excellent communication and collaboration skills