Estimated Start Date : Oct 1, 2025

Duration : 12 months (Contract-to-Hire)

We are seeking a highly skilled Senior Cloud Migration Engineer to lead the transformation of our EMR workloads from EC2-based infrastructure to EMR Serverless.

This strategic role focuses on enhancing scalability, reducing operational overhead, and improving cost efficiency across our cloud-native data processing platform.

Key Responsibilities :

Migration Planning & Assessment :

- Analyze existing EC2-based EMR jobs to assess their suitability for serverless migration

- Prioritize workloads based on business impact, complexity, and readiness
- Conduct deep code discovery and ensure alignment with production standards

- Audit and synchronize code repositories with live production environments

Technical Implementation :

- Transition Hadoop/HDFS workloads to Amazon S3-based architectures

- Refactor data processing pipelines to leverage Amazon Athena

- Upgrade and modernize runtime environments (e.g., Python versions)

- Ensure full dependency compatibility across target serverless stacks

Infrastructure Modernization :

- Integrate EMR Serverless logging with AWS CloudWatch

- Configure centralized logging via AWS Log Groups

- Optimize workflows for observability and performance in a serverless model

- Migrate legacy scheduling (e.g., Control-M, cron) to AWS Step Functions

- DevOps - GitHub and Workflow Experience

Quality Assurance & Deployment :

- Design and implement robust testing strategies across staging and QA environments

- Document test plans, validation procedures, and migration outcomes

- Collaborate with the AMI and QA teams for pre-deployment sign-offs

- Execute controlled production rollouts with post-deployment monitoring

Required Qualifications :

- 5+ years of experience with Amazon EMR and big data platforms

- Deep expertise in Apache Spark, Hadoop ecosystem, and AWS cloud services

- Proficient in Python and version management

- Hands-on experience with AWS Step Functions, CloudWatch, and serverless solutions

- Familiarity with job schedulers like Control-M or cron

- Strong knowledge of Amazon S3, Athena, and data lake architectures

Preferred Qualifications

- AWS Certifications (Solutions Architect, DevOps Engineer, or Data Analytics)

- Experience with Infrastructure as Code (IaC) tools such as CloudFormation or Terraform

- Proven success in enterprise-scale cloud/data migration projects

- Experience working in Agile environments using JIRA or similar tools

Success Metrics :

- Full migration of selected EMR jobs to EMR Serverless

- Meet or exceed existing EC2-based performance benchmarks

- Demonstrable cost savings post-migration

- Zero data loss throughout the migration process

- Successful completion of quality checks and stakeholder approvals