We are looking for an experienced Databricks Unified Data Analytics Platform Engineer to design, develop, and optimize scalable data solutions on the Databricks platform.

The ideal candidate should have hands-on experience with big data technologies, ETL pipelines, cloud platforms, and modern data engineering practices.

Key Responsibilities :

- Design, develop, and maintain scalable data pipelines using Databricks.

- Build and optimize ETL/ELT workflows for structured and unstructured data.

- Develop data processing solutions using Apache Spark (PySpark/Scala).

- Work with Delta Lake, Databricks SQL, and Unity Catalog.

- Integrate data from multiple sources into enterprise data platforms.

- Optimize data processing performance and ensure high availability.

- Collaborate with data scientists, analysts, and business stakeholders.

- Implement data governance, security, and best practices.

- Troubleshoot and resolve production issues.

Required Skills :

- Strong hands-on experience with Databricks Unified Data Analytics Platform.

- Apache Spark (PySpark/Scala).

- Delta Lake.

- Databricks SQL.

- SQL.

- Python.

- ETL/ELT Development.

- Azure Databricks, AWS Databricks, or GCP Databricks.

- Data Warehousing concepts.

- Git/Version Control.

- Performance Tuning and Optimization.

Preferred Skills :

- Unity Catalog.

- Azure Data Factory (ADF), AWS Glue, or similar ETL tools.

- Apache Kafka.

- Airflow.

- CI/CD pipelines.

- Knowledge of Data Lakehouse architecture.