Elanco - Data Engineer - Azure Data Factory

Role Overview :

We are seeking a skilled Data Engineer to join our growing data and analytics team.

The ideal candidate will design, build, and optimize scalable data pipelines, ensuring clean, reliable, and high-performance data delivery for analytics and machine learning initiatives.

You will work with cloud-native tools, especially Azure Data Factory (ADF), Databricks, and Python, to support enterprise-wide digital transformation.

Key Responsibilities :

- Design, develop, and maintain end-to-end ETL/ELT data pipelines using ADF and Databricks.

- Implement robust data ingestion frameworks for structured, semi-structured, and unstructured data sources.

- Collaborate with business stakeholders, data scientists, and analysts to deliver high-quality datasets.

- Develop and optimize data models and data lakes to support BI and ML workloads.

- Ensure data quality, lineage, and governance across pipelines.

- Automate workflows and monitoring for data jobs, ensuring minimal downtime.

- Troubleshoot issues, optimize performance, and ensure scalability of data solutions.

- Document technical processes, workflows, and best practices for knowledge sharing.

Required Skills & Qualifications :

- Strong expertise in Azure Data Factory (ADF), Databricks, and Python programming.

- Solid understanding of SQL, data warehousing, and big data ecosystems.

- Experience with data modeling, schema design, and performance optimization.

- Strong problem-solving and debugging skills in large-scale distributed data environments.

- Familiarity with Agile methodologies and DevOps concepts for data engineering.

Preferred Skills :

- Knowledge of Delta Lake, Spark, or Synapse Analytics.

- Hands-on experience with CI/CD pipelines for data solutions.

- Exposure to cloud platforms like Azure/AWS/GCP