HamburgerMenu
hirist

Lead Data Engineer - Python/SQL/ETL

TAP AI PRIVATE LIMITED
8 - 10 Years
Hyderabad

Posted on: 16/04/2026

Job Description

Job Title : Tech Lead - Azure Databricks / Data Engineering


Job Description :

We are looking for a hands-on Tech Lead - Azure Databricks / Data Engineering with 8+ years of overall experience and strong expertise in building cloud-based data and analytics solutions. The ideal candidate should come from a strong DWH / ETL background and bring solid experience in Azure Databricks, PySpark, Azure Data Factory, SQL, streaming data on Azure, and Big Data technologies. This role requires both technical depth and leadership capability, including mentoring junior team members, driving delivery, and working closely with client technical stakeholders.

Key Responsibilities :

- Lead the design and development of cloud data and analytics solutions on Azure

- Build and optimize ETL / ELT pipelines using Azure services

- Work hands-on with Azure Databricks, PySpark, and Azure Data Factory

- Develop and maintain scalable data processing solutions for batch and real-time use cases

- Work on data warehouse modernization and business intelligence support use cases

- Handle heterogeneous data wrangling and transformation

- Build complex Spark-based data pipelines using Python / Scala where required

- Work with Azure Event Hubs, Pub-Sub concepts, and security considerations

- Use Azure DevOps and Unity Catalog as part of the delivery lifecycle

- Mentor junior developers and testers

- Collaborate effectively with client technical teams and internal stakeholders

- Work in Agile delivery environments with strong ownership and communication

Required Skills :

- 8+ years of overall IT / Data Engineering experience

- Minimum 3+ years of Azure experience

- Minimum 3+ years in lead / technical leadership capacity

- Strong DWH background

- Strong ETL experience

- Strong hands-on experience in Azure Databricks / PySpark

- Strong hands-on experience in Azure Data Factory

- Experience with Azure DevOps

- Experience with Unity Catalog

- Real-time / streaming data experience on Azure

- Strong knowledge of Big Data stack

- Strong knowledge of Azure Event Hubs

- High proficiency in SQL

- Strong communication and analytical skills

- Experience working in Agile environments

Optional / Good to Have :

- Scala with Spark

- Exposure to BI / DaaS solutions

- Strong client-facing delivery experience

- Experience mentoring teams in enterprise data programs

Work Location : Hyderabad

Shift : 12 PM to 9 PM


info-icon

Did you find something suspicious?

Similar jobs that you might be interested in