About The Role:

We are looking for a Senior Data Engineer with strong expertise in Azure Data Engineering to design, build, automate, and maintain scalable data pipelines supporting Machine Learning and Analytics initiatives.

The ideal candidate will have hands-on experience with Azure-based data platforms, data pipeline automation, dataset management, data quality, and enterprise data engineering practices. The role requires close collaboration with Data Scientists, ML Engineers, and regional teams to ensure reliable data availability, efficient data refresh cycles, and operational excellence across production data pipelines.

Key Responsibilities:

- Design, develop, and automate scalable data pipelines for dynamic and frequently changing datasets.

- Build robust data workflows to support Machine Learning and Analytics use cases.

- Optimize data compilation and processing workflows to improve data refresh frequency and efficiency.

- Ensure reliable and timely availability of data for downstream applications and stakeholders.

- Compile, prepare, and manage datasets required for ML models and analytical initiatives.

- Develop processes to support timely dataset refresh requests.

- Perform data cleansing, validation, and quality checks across critical datasets.

- Collaborate closely with Data Scientists, ML Engineers, and regional teams.

Tech Stack & Requirements:

- Strong hands-on experience in Azure Data Engineering.

- Proven experience in developing and automating data pipelines.

- Strong understanding of data preparation, data cleansing, and data quality management.

- Experience in managing and refreshing datasets for Machine Learning and Analytics use cases.

- Ability to optimize data processing workflows for performance and efficiency.

- Strong analytical, problem-solving, and communication skills.

Good to Have:

- Experience with model monitoring and identifying model drift.

- Knowledge of production model performance monitoring and reporting.

- Exposure to Machine Learning and model lifecycle management.

What Youll Do:

As a Senior Data Engineer, you will play a key role in ensuring that high-quality, reliable, and up-to-date data is continuously available for ML and Analytics initiatives. You will own critical data pipeline automation, dataset management, data quality, and operational processes while working closely with technical and regional stakeholders.