HamburgerMenu
hirist

Lead Data Engineer - ETL/Python

The Recruiting Webs
6 - 10 Years
Mumbai

Posted on: 19/06/2026

Job Description

Lead Data Engineer :

We are seeking a highly skilled and delivery-focused Lead Data Engineer to design and build enterprise-grade data platforms and applications under the Durables model. This role will be responsible for leading end-to-end new implementation and development initiatives, building scalable data pipelines, and architecting cloud-native solutions on AWS.

Key Responsibilities :

- Lead end-to-end design and development of scalable, high-performance data engineering solutions.

- Architect and implement new data pipelines, data models, and cloud-native data platforms.

- Design modular, reusable, and future-ready data frameworks for enterprise use cases.

- Provide architectural direction for new data platform development and modernization initiatives.

- Build and optimize data pipelines using AWS services (Glue, Lambda, Redshift, S3, EMR, Athena, etc.).

- Leverage PySpark, SQL, Python, and distributed processing frameworks for large-scale data processing.

- Lead sprint planning, estimation, and delivery of development milestones in Agile environments.

- Act as a technical advisor for clients during solution design and implementation phases.

- Lead and mentor a team of data engineers.

- Establish CI/CD pipelines, version control practices, and automated testing frameworks.

Required Skills & Qualifications :

- 6+ years of experience in Data Engineering, Data Platform Development, or Application Development.

- Strong hands-on expertise in AWS cloud services (Glue, Lambda, Redshift, S3, Athena, EMR, CloudWatch).

- Proficiency in PySpark, SQL, and Python for large-scale data processing.

- Strong experience in designing and building end-to-end data pipelines and data platforms.

- Deep understanding of distributed data processing and performance optimization.

- Proven experience leading engineering teams (3+ years).

- Strong client-facing and communication skills.

- Experience with Agile delivery methodologies.

- Familiarity with tools like JIRA, Confluence, Git, Jenkins, or CI/CD pipelines.

The job is for:

Women candidates preferred
Differently-abled candidates preferred
Ex-defence personnel preferred
For women joining back the workforce
info-icon

Did you find something suspicious?

Similar jobs that you might be interested in

Loading chat...