AWS Data Engineer - PySpark/SQL

Job Description :

We are looking for an experienced and highly skilled Technical Lead to guide the development and enhancement of a large-scale Data Observability solution built on AWS.

This platform is pivotal in delivering monitoring, reporting, and actionable insights across the client's data landscape.

The Technical Lead will drive end-to-end feature delivery, mentor junior engineers, and uphold engineering best practices.

The position reports to the Programme Technical Lead / Architect and involves close collaboration to align on platform vision, technical priorities, and success KPIs.

Key Responsibilities :

- Lead the design, development, and delivery of features for the data observability solution.

- Mentor and guide junior engineers, promoting technical growth and engineering excellence.

- Collaborate with the architect to align on platform roadmap, vision, and success metrics.

- Ensure high quality, scalability, and performance in data engineering solutions.

- Contribute to code reviews, architecture discussions, and operational readiness.

Primary Must-Have Skills (Non-Negotiable) :

- 5+ years in Data Engineering or Software Engineering roles.

- 3+ years in a technical team or squad leadership capacity.

- Deep expertise in AWS Data Services: Glue, EMR, Kinesis, Lambda, Athena, S3.

- Advanced programming experience with PySpark, Python, and SQL.

- Proven experience in building scalable, production-grade data pipelines on cloud platforms.

Skills : Amazon Web Services (AWS), Python, PySpark and SQL.