Databricks SQL Engineer - Python/PySpark

Mandatory Skills :

- Databricks

- SQL

- PySpark

- Pharma or Life Sciences domain experience

Role Overview/Job Summary :

- We are looking for an experienced Databricks SQL Engineer with a Pharma or Life Sciences background to join our offshore Data Engineering team.

- This role focuses on building efficient, scalable SQL-based data models and pipelines using Databricks SQL, Spark SQL, and Delta Lake.

- The ideal candidate will play a key role in transforming raw data into valuable analytical insights, enabling critical decision-making across pharma-related business functions.

Key Responsibilities/Job Responsibilities :

- Design and optimize SQL queries and data models in Databricks for large-scale datasets

- Develop and maintain robust ETL/ELT pipelines using Databricks workflows

- Implement Delta Lake and Unity Catalog for secure and governed data assets

- Ensure data quality via validation, testing, and monitoring mechanisms

- Optimize performance and cost for the data lakehouse environment

- Collaborate with stakeholders to support analytics and business needs

- Deploy notebooks and SQL workflows using CI/CD best practices

- Document pipelines, queries, and data models to foster self-service