Job Summary :

We are looking for a Senior AWS Data Engineer to design, build, and optimize scalable cloud-based data platforms. The ideal candidate should have strong expertise in AWS data services, ETL development, data warehousing, and big data technologies. You will collaborate with data scientists, analysts, and application teams to deliver high-quality, reliable, and secure data solutions.

Key Responsibilities :

- Design and develop scalable data pipelines using AWS cloud services.

- Build and maintain enterprise-grade ETL/ELT processes for structured and semi-structured data.

- Develop and optimize data lakes and data warehouse architectures.

- Work with large-scale datasets while ensuring data quality, consistency, and integrity.

- Implement data transformation and orchestration workflows using AWS services.

- Optimize query performance and storage costs across cloud platforms.

- Develop reusable frameworks for data ingestion and processing.

- Ensure security, governance, and compliance across data platforms.

- Troubleshoot production issues and improve pipeline reliability.

- Collaborate with cross-functional teams to understand business data requirements.

Required Skills :

- Strong experience with AWS services including S3, Glue, Lambda, EMR, Redshift, Athena, IAM, and CloudWatch.

- Expertise in Python, SQL, and PySpark.

- Experience with Apache Spark and distributed data processing.

- Knowledge of ETL tools and workflow orchestration.

- Experience with Airflow or similar scheduling tools.

- Hands-on knowledge of data warehousing concepts.

- Familiarity with Docker, Kubernetes, and CI/CD pipelines.

- Experience working with relational and NoSQL databases.

- Understanding of data governance and security best practices.

Preferred Skills :

- AWS Certified Data Analytics or Solutions Architect certification.

- Experience with Kafka or streaming data platforms.

- Knowledge of Infrastructure as Code using Terraform or CloudFormation.