Azure Data Engineer - ETL/Synapse Analytics

Job Description :

Responsibilities :

- Design, develop, and maintain scalable data pipelines using Azure Data Factory, Azure Synapse, and other Azure services.

- Architect and implement data lake and data warehouse solutions on Azure.

- Perform data ingestion, transformation, and integration from various structured and unstructured sources.

- Collaborate with data scientists, analysts, and business stakeholders to understand data requirements and deliver solutions.

- Optimize data workflows for performance, reliability, and cost-efficiency.

- Implement data governance, security, and compliance standards across Azure data platforms.

- Automate data processes using Azure Functions, Logic Apps, and CI/CD pipelines.

- Monitor, troubleshoot, and enhance data systems and workflows.

Requirements :

- Bachelor's or Master's degree in Computer Science, Engineering, or a related field.

- 5 to 12 years of experience in data engineering, with at least 5 years on Azure

- Expertise in Azure Data Factory, Azure Synapse Analytics, Azure SQL, Data Lake Storage, and related services.

- Strong proficiency in SQL and scripting languages like Python or Scala.

- Experience with data modeling, ETL/ELT design, and performance tuning.

- Familiarity with DevOps practices and tools (Azure DevOps, Git, etc. ).

- Understanding of data governance, privacy, and security principles.

- Excellent communication and stakeholder management skills.

Preferred Qualifications :

- Microsoft Certified: Azure Data Engineer Associate (DP-203).

- Experience with Databricks, Power BI, or other BI tools.

- Exposure to big data technologies and real-time data processing.

- Knowledge of Agile methodologies and project delivery frameworks.