Description :

Job Summary :

We are looking for an AWS Data Engineer with around 4 years of experience to design, build, and maintain scalable data pipelines and data platforms on AWS.

The ideal candidate will work closely with data analysts, data scientists, and business stakeholders to deliver reliable, high-quality data solutions.

Key Responsibilities :

- Design, develop, and maintain scalable data pipelines using AWS services

- Build and optimize ETL/ELT pipelines for structured and semi-structured data

- Implement data ingestion from multiple sources (databases, APIs, streaming systems)

- Develop data solutions using AWS Glue, Lambda, EMR, Redshift, Athena

- Manage and optimize data storage using Amazon S3, Redshift, and RDS

- Ensure data quality, data governance, and security best practices

- Work with batch and near-real-time processing

- Optimize performance and cost of AWS data solutions

- Collaborate with cross-functional teams to translate business requirements into technical solutions

- Monitor pipelines and troubleshoot data issues

Required Skills :

AWS & Data Engineering :

- Strong hands-on experience with AWS services :

1. S3, Glue, Redshift, Athena, Lambda

2. EMR (Spark/Hadoop)

3. CloudWatch, IAM

- Experience with data warehousing and data lake architectures

Programming & Querying :

- Proficiency in Python (preferred) or Scala

- Strong SQL skills for analytics and transformations

Big Data & Processing :

- Experience with Apache Spark (PySpark preferred)

- Knowledge of batch and streaming data concepts

Databases :

- Experience with relational databases (MySQL, PostgreSQL)

- Familiarity with NoSQL databases (DynamoDB is a plus)