Data Engineer - Python/Spark

Description :

Job Title : Databricks Data Engineer

Location : PAN India

Years for Exp : 10-12 yrs

Must Have :

- Databricks

- DBT (Data Build Tool)

- SQL

- DAB

- Spark

- Delta tables

Nice to have :

- Collibra DQ

- Collibra

- Jenkins

Job Description :

- Build and maintain robust data pipelines using Python, Databricks, Spark, DBT, and Delta Lake to transform and deliver high quality analytics-ready datasets.

- Design and implement efficient data models (star, snowflake, and dimensional schemas), choosing normalized or denormalized structures based on performance and use cases.

- Write performant SQL and Databricks notebooks, manage versioning and orchestration, and ensure data quality and lineage across pipelines.

- Leveraging tools GitHub actions/Jenkins to automate testing, validation, and deployments.

- Implement best practices in data modeling, performance tuning, and scalable architecture and coding practices.

Nice-to-have additions :