Job Description :

We are seeking a skilled Databricks Consultant to join our Data Analytics Transformation Project. As part of the team, you will be responsible for automating data workflows, implementing data quality checks, and ensuring that data governance policies are enforced across the organization.

Your key responsibilities will include :

- Automating complex data workflows and optimizing data pipeline processes using Databricks tools such as Workflows, Delta Lake, Unity Catalog, and Genie.

- Ensuring data quality by implementing DQX frameworks and maintaining high standards of governance.

- Utilizing PySpark, Spark SQL, Python, and SQL to design efficient solutions and improve system performance.

- Collaborating with cross-functional teams to troubleshoot issues, monitor performance, and ensure optimal system scalability and efficiency.

Key Qualifications :

- Proven experience in Databricks and related tools (Workflows, Delta Lake, Genie).

- Strong proficiency in PySpark, Spark SQL, Python, and SQL.

- Experience with data quality frameworks (DQX) and workflow orchestration tools like Airflow.

- Strong problem-solving abilities and a deep understanding of performance optimization.

Experience Required : 5 - 8 years in relevant data engineering or analytics roles.

Open Positions : 1

Duration : 2 months