HamburgerMenu
hirist

Decision Point - Lead Data Engineer - AWS

Posted on: 01/10/2025

Job Description

Roles & Responsibilities :


- Design, develop, and maintain ETL pipelines using PySpark and AWS Glue.

- Build and optimize data workflows on AWS cloud platforms ensuring scalability and performance.

- Develop and manage data integration between Snowflake and various data sources.

- Write and optimize complex SQL queries for data extraction, transformation, and analysis.

- Ensure data quality, integrity, and governance across pipelines and storage systems.

- Collaborate with data analysts, data scientists, and business teams to deliver reliable datasets.

- Monitor, troubleshoot, and improve performance of ETL jobs and data pipelines.

- Implement best practices for cost optimization, security, and compliance in AWS data solutions.

- Contribute to architecture discussions and recommend improvements for data platforms.

Requirements :


- 7+ years of experience in data engineering.

- Strong hands-on expertise in AWS Glue, PySpark, and ETL development.

- Advanced SQL programming skills with ability to write complex queries.

- Strong knowledge of AWS services (S3, Lambda, Athena, Redshift, IAM, etc.).

- Experience in data modeling, schema design, and data pipeline orchestration.


The job is for:

Women candidates preferred
Differently-abled candidates preferred
Ex-defence personnel preferred
For women joining back the workforce
info-icon

Did you find something suspicious?

Similar jobs that you might be interested in