Databricks Engineer - Azure Data Services

Azure Databricks Engineer

We are looking for a skilled Azure Databricks Engineer with 5-10 years of experience in Azure Data Services, including Azure Data Factory (ADF), Synapse Analytics, and Databricks.

The candidate will play a key role in developing and maintaining data solutions on Azure.

Responsibilities :

- Develop and implement data pipelines using Azure Data Factory and Databricks.

- Work with stakeholders to gather requirements and translate them into technical solutions.

- Migrate data from various data sources to Azure Data Lake.

- Optimize data processing workflows for performance and scalability.

- Ensure data quality and integrity throughout the data lifecycle.

- Collaborate with data architects and other team members to design and implement data solutions.

Requirements :

- Strong experience with Azure Data Services, including Azure Data Factory (ADF), Synapse Analytics, and Databricks.

- Proficiency in SQL, data transformation, and ETL processes.

- Hands-on experience with Azure Data Lake migrations and Python/PySpark.

- Strong problem-solving and analytical skills.

- Excellent communication and teamwork skills.

Preferred Qualifications :

- Azure Data Engineer Associate certification.

- Databricks Certification.

Mandatory skill set : PySparkDatabricks, Python, and SQL