Description :

Job Summary :

We are looking for an experienced Data Engineer with around 3 years of hands-on experience, strong expertise in Azure Databricks and Azure Database services. The ideal candidate will be responsible for building and maintaining scalable data pipelines, ensuring data quality, and supporting analytical and operational use cases. Experience with AWS Databricks is also acceptable.

Key Responsibilities :

- Design, develop, and manage data pipelines and ETL processes using Azure Databricks (or AWS Databricks).

- Integrate data from various sources into Azure data platforms (e.g., Data Lake, Synapse, Azure SQL).

- Work closely with data scientists and analysts to provide clean, structured, and reliable datasets for analysis and modeling.

- Implement best practices for data quality, security, and governance.

- Optimize data flows and storage for scalability and performance.

- Monitor and troubleshoot data pipelines, ensuring reliability and minimal downtime.

- Contribute to the design and implementation of data models and architectures that support business intelligence and analytics.

Required Skills & Experience :

- 3+ years of experience as a Data Engineer or in a related role.

- Strong expertise in Azure Databricks (or AWS Databricks).

- Hands-on experience with Azure Database services and data storage solutions.

- Proficiency in SQL, Python, and data transformation frameworks.

- Solid understanding of ETL/ELT concepts, data modeling, and data warehousing.

- Familiarity with version control tools (e.g., Git) and CI/CD pipelines.

- Good problem-solving skills and ability to work in cross-functional teams.

Preferred Qualifications :

- Azure or Databricks certifications.

- Experience with big data technologies and distributed computing frameworks.

- Exposure to data orchestration tools like Azure Data Factory, Airflow, or similar.

- Knowledge of MLOps or analytics platforms is a plus.