Description :

We are looking for a skilled Azure Data Engineer to design, build, and maintain scalable data pipelines and architectures in Microsoft Azure.

You will play a crucial role in enabling data-driven decision-making by transforming raw data into accessible, clean, and reliable datasets.

If you have hands-on experience with Azure data services and a passion for solving complex data challenges, this is an exciting opportunity to join a forward-thinking team shaping the future of data infrastructure.

Key Responsibilities :

- Design, develop, and maintain robust data pipelines using Azure Data Factory, Azure Databricks, Azure Synapse Analytics, and other Azure data services.

- Build scalable ETL/ELT processes to ingest, process, and transform large volumes of structured and unstructured data from various sources.

- Implement and optimize data storage solutions, including Azure Data Lake Storage, Azure SQL Database, and Cosmos DB.

- Collaborate with data scientists, analysts, and business stakeholders to understand data requirements and deliver reliable data solutions.

- Monitor data quality, troubleshoot data issues, and implement data governance best practices.

- Automate workflows and data integration tasks using Azure Logic Apps, Functions, and PowerShell scripts.

- Ensure data security and compliance with organizational and regulatory policies.

- Document data pipelines, data flows, and architecture diagrams for knowledge sharing and auditing purposes.

- Stay current with Azure data technologies and industry trends to continuously improve data platform capabilities.

Requirements :

Experience :

- 3+ years of experience as a Data Engineer or similar role, preferably working with Azure cloud platforms.

- Proven experience designing and implementing data pipelines and ETL workflows on Azure.

Technical Skills :

- Strong proficiency with Azure Data Factory, Azure Databricks, Azure Synapse Analytics, and Azure Data Lake Storage.

- Solid understanding of SQL and experience working with relational and NoSQL databases.

- Experience with data modeling, data warehousing concepts, and performance optimization.

- Knowledge of programming languages such as Python, Scala, or SQL for data transformation and automation.

- Familiarity with containerization (Docker) and orchestration tools (Kubernetes) is a plus.

- Experience with version control systems (Git) and CI/CD pipelines in a cloud environment.

Soft Skills :

- Strong analytical and problem-solving skills.

- Excellent communication skills, capable of working with both technical and non-technical stakeholders.

- Ability to work independently and collaboratively in a fast-paced environment.

Education :

- Bachelors degree in Computer Science, Information Technology, or related field preferred.

- Equivalent experience considered