About the Role :

We are looking for an experienced Data Engineering Lead to lead the data engineering track for a large-scale analytics platform supporting a major Oil & Gas enterprise.

Key Technologies :

- AWS Glue, AWS Lambda

- Amazon Redshift, Aurora PostgreSQL

- MSK Kafka, AWS SQS, AWS Transfer Family

- Apache Airflow

- SQL, Python

Key Responsibilities :

- Lead a team of 3 Data Engineers.

- Manage and enhance large-scale data assets and ETL pipelines.

- Drive ETL performance, monitoring and optimization.

- Handle production incidents and P1 issues as part of a 24x7 rotation.

- Deliver enhancements within defined SLAs.

- Collaborate with business and technical stakeholders.

- Create and maintain runbooks and technical documentation.

Requirements :

- 8+ years of experience in Data Engineering with leadership experience.

- Strong expertise in AWS Glue, Redshift and Aurora.

- Strong SQL and Python skills.

- Experience managing production data pipelines at scale.

- Willingness to work from the Mumbai client site as required.

- Comfortable with weekend/night on-call rotation.

Good to Have :

- Experience in the Oil & Gas domain.

- Experience working on large-scale enterprise analytics platforms.