Senior Data Engineer - AWS Platform

Description :

Role : Data Engineer (AWS)

Role Overview :

We are looking for a skilled Data Engineer to design, build, and scale modern data platforms on AWS. In this role, you will leverage Python, Spark, DBT, and AWS-native services to develop secure, scalable, and high-performance data solutions within an Agile environment.

You will play a key role in shaping data architecture, enabling analytics, and supporting data-driven decision-making across the organization.

Required Skills & Experience :

- 4 to 7 years of experience in Data Engineering, including 3+ years working extensively with AWS.

- Strong programming expertise in Python (including AWS SDKs), SQL, DBT, and Apache Spark.

- Proven hands-on experience with AWS data services :

1. S3

2. Glue

3. EMR

4. Redshift

5. Athena

6. Lambda

- Experience with workflow orchestration tools such as Airflow or AWS Step Functions.

- Solid understanding of modern data lake formats (Parquet, ORC, Iceberg).

- Familiarity with DevOps practices including Terraform and CI/CD pipelines.

- Strong knowledge of data governance, access control, and security best practices.

What Youll Do :

- Design, develop, and optimize ETL/ELT pipelines using Python, DBT, and AWS services.

- Build and maintain S3-based data lakes leveraging modern storage formats (Parquet, ORC, Iceberg).

- Deliver end-to-end data solutions using Glue, EMR, Lambda, Redshift, and Athena.

- Implement metadata management, governance, and security frameworks using :

1. Glue Data Catalog

2. Lake Formation

3. IAM

4. KMS

- Orchestrate and monitor data workflows using Airflow, Step Functions, or AWS-native tools.

- Ensure reliability, observability, and automation using CloudWatch, CloudTrail, CodePipeline, and Terraform.

- Collaborate closely with analysts and data scientists to enable advanced analytics and business insights in an Agile setup.

Bonus Skills :

- Exposure to Data Mesh principles and platforms such as Data.World.

- Experience working with Hadoop/HDFS in hybrid or legacy data environments.