Senior Azure Data Engineer

Description :

Job Summary :

We are seeking a skilled and motivated Azure Data Engineer with experience in designing, building, and optimizing scalable data pipelines. The ideal candidate should have strong hands-on experience with Azure data services, particularly Azure Databricks (ADB) and Azure Data Factory (ADF), along with expertise in Python, PySpark, and SQL.

Key Responsibilities :

- Design, develop, and maintain scalable and reliable data pipelines using Azure services.

- Build and optimize ETL/ELT processes using Azure Data Factory (ADF) and Azure Databricks

(ADB).

- Develop data processing solutions using Python and PySpark.

- Work with structured and unstructured data from multiple sources.

- Write complex SQL queries and optimize performance across RDBMS (Oracle, PostgreSQL, SQL Server, etc.).

- Ensure data quality, integrity, and governance across pipelines.

- Implement best practices for data engineering, including CI/CD and version control.

Role Requirements :

- 6+ years of relevant experience in azure data engineer.

Strong hands-on experience with :

1. Azure Data Factory (ADF)

2. Azure Databricks (ADB)

- Proficiency in Python and PySpark.

- Strong SQL skills with experience in any RDBMS (Oracle, PostgreSQL, SQL Server, etc.).

- Solid understanding of data pipelines, ETL/ELT concepts, and data processing frameworks.

- Experience in handling large-scale data processing and optimization.