HamburgerMenu
hirist

Senior Databricks Engineer - Python/ETL/SQL

The Edge Partnership
5 - 10 Years
rupee25-35 LPA
Multiple Locations

Posted on: 09/06/2026

Job Description

Job Description :

We are looking for a Senior Data Engineer to join our Data & AI Practice, working on modern data platforms for enterprise and regulated clients. You will be a hands on engineer with strong production experience, contributing to the design, build, and operation of scalable, cloud native data solutions that enable analytics and AI at scale.

This is a delivery focused role for an experienced engineer who enjoys solving complex data challenges, takes ownership of outcomes, and applies strong engineering discipline in real world environments.

What Youll Be Doing :

- Designing, building, and operating reliable data pipelines using modern ETL/ELT approaches

- Engineering cloud native data platforms, primarily on AWS (with Azure exposure where required)

- Working with technologies such as Databricks, PostgreSQL, Aurora, and distributed processing frameworks

- Ensuring solutions are production ready : secure, tested, observable, and cost efficient

- Optimising data performance, reliability, and data quality in live environments

- Collaborating with analysts, data scientists, AI engineers, and platform teams

- Mentoring junior engineers and contributing to shared standards and accelerators

What Youll Bring :

- 5+ years experience in hands on data engineering roles

- Strong data engineering skills using Databricks

- Strong programming skills in Python, Java, Spark and advanced SQL

- Need FS experience

- Proven experience building and running data pipelines in production

- Solid understanding of distributed systems and scalable data architectures

- Hands on experience with AWS data services and cloud native platforms

- Experience with Databricks or similar distributed data processing platforms

- Solid understanding of data modeling and data quality approaches

- Experience building and operating both batch and streaming data pipelines

- Familiarity with CI/CD, monitoring, and operational support of data platforms

- Contribute to technical design discussions and help improve system performance, scalability, and reliability

- Support production systems by troubleshooting issues and implementing improvement.

Nice to Have :

- Experience enabling ML, AI, or GenAI workloads through strong data foundations

- Exposure to modern BI and analytics tooling

- Experience working in regulated or security conscious environments

- Consulting or client facing delivery experience

The job is for:

Women candidates preferred
Ex-defence personnel preferred
For women joining back the workforce
info-icon

Did you find something suspicious?

Similar jobs that you might be interested in

Loading chat...