Databricks Developer - Python/PySpark

Databricks Developer :

We are seeking a Databricks Developer to enhance our data engineering team. This role focuses on building scalable data pipelines, optimizing performance, and enabling analytics innovation.

Responsibilities :

- Develop and optimize Spark pipelines using Databricks and Delta Lake.

- Write production-grade PySpark/Scala code for ETL and data transformation.

- Integrate structured and unstructured data across Azure and AWS cloud platforms.

- Implement Delta Live Tables, Unity Catalog, and CI/CD workflows.

- Collaborate with data scientists and stakeholders to deliver high-quality datasets.

- Ensure data governance, security, and lifecycle compliance.

- Mentor junior engineers and contribute to architectural decisions.

Qualifications :

- 5-7 years of experience in Big Data development.

- Strong hands-on experience with Databricks, PySpark, SQL, and cloud tools.

- Familiarity with Azure Data Factory, Synapse, or AWS Glue/Redshift.

- Knowledge of GitHub Actions, Azure DevOps, and Agile delivery.

- Bonus: Experience with Airflow, Kafka, ML workflows, and relevant certifications.