About the Role:

KPI Partners is seeking a skilled Azure Data Engineer with expertise in data engineering, cloud solutions, and experience with data pipeline development using Azure services. You will play a key role in designing and implementing scalable data solutions that drive insights and business decisions for our clients.

Key Responsibilities:

- Design, develop, and maintain data pipelines.

- Collaborate with data scientists, analysts, and stakeholders to understand data requirements and deliver high-quality data solutions.

- Optimize data workflows for performance and scalability within the Azure environment.

- Ensure data quality, integrity, and security throughout the data lifecycle.

- Monitor and troubleshoot data processing issues to maintain smooth operations.

- Document processes, architectures, and data models for knowledge sharing and compliance.

- Stay updated with the latest trends and technologies in data engineering and cloud computing.

Mandatory Skills :

- ADF, SQL, Pyspark, Python, Databricks

Qualifications :

- Bachelor's degree in Computer Science, Data Science, Engineering, or a related field.

- Proven 6+ years of experience as a Data Engineer, with a focus on ADF, Pyspark, Python, and SQL.

- Proficiency in SQL and experience with programming languages such as Python or Scala.

- Familiarity with Azure data services, including Azure Data Lake, Azure SQL Database, and Azure Synapse Analytics.

- Strong analytical and problem-solving skills with attention to detail.

- Excellent communication and collaboration skills to work effectively across teams.