As a Databricks Data Engineer, you will be responsible for :

- Technical Requirements Gathering and Development of Functional Specifications.

- Design, develop, and maintain scalable data pipelines and ETL processes using Azure Databricks, Data Factory, and other Azure services.

- Implement and optimize Spark jobs, data transformations, and data processing workflows in Databricks.

- Develop and integrate custom machine learning models using Azure Machine Learning, MLflow, and other relevant libraries.

- Leverage Azure DevOps and CI/CD best practices to automate the deployment and management of data pipelines and infrastructure.

- Conducting troubleshooting on data models.

- Work with the Agile multicultural teams in Asia, the EU, Canada, and the USA.

Profile Requirements :

For this position as Databricks Data Engineer, we are looking for someone with :

- (Required) At least 6 years of experience in developing and maintaining data pipelines using Azure Databricks, Azure Data Factory, and Spark.

- (Required) Hands-on experience with Unity Catalog

- (Required) Fluent English communication and soft skills.

- (Required) Knowledge and Experience in CICD such as Terraform, ARM, and Bicep Script.

- (Required) Solid technical skills in Python, and SQL

- (Required) Familiarity with machine learning concepts, tools, and libraries (e.g., TensorFlow, PyTorch, Scikit-learn, MLflow)

- (Required) Strong problem-solving, communication, and analytical skills.

- Willingness to learn and expand technical skills in other areas.