Job Overview :

We are looking for a skilled Azure Data Engineer to design, build, and maintain scalable data pipelines and solutions on the Microsoft Azure platform.

The ideal candidate will have strong expertise in data engineering, cloud technologies, and big data frameworks, with a focus on delivering high-quality, reliable data solutions.

Key Responsibilities :

- Design, develop, and maintain scalable data pipelines using Azure data services.

- Build and optimize ETL/ELT processes for data ingestion, transformation, and loading.

- Work with structured and unstructured data from multiple sources.

- Develop and manage data workflows using Azure Data Factory, Azure Databricks, and related services.

- Ensure data quality, integrity, and security across data platforms.

- Collaborate with data scientists, analysts, and business stakeholders to understand data requirements.

- Implement data models and optimize performance for reporting and analytics.

- Monitor and troubleshoot data pipelines and workflows.

- Maintain documentation for data architecture and processes.

Required Skills & Qualifications :

Technical Skills :

- Strong proficiency in Python, SQL, and/or PySpark.

- Hands-on experience with Azure Data Factory (ADF), Azure Databricks, and Azure Data Lake.

- Experience with big data technologies such as Spark and distributed data processing.

- Knowledge of ETL/ELT concepts and data pipeline development.

- Experience with data warehousing solutions like Azure Synapse Analytics.

- Understanding of data modeling concepts (star schema, snowflake schema).

- Familiarity with Azure DevOps, CI/CD pipelines, and version control (Git).

- Experience with REST APIs and data integration