Role Overview:

As a Data Architect (Migration Hadoop to AWS) you will be at the forefront of our cloud migration initiatives, leading the design and implementation of data migration strategies from on-premise Hadoop environments to AWS.

You will collaborate closely with data engineers, data scientists, and business stakeholders to ensure a seamless and efficient transition, while optimizing data pipelines and infrastructure for performance and scalability.

Your expertise will be instrumental in enabling our clients to leverage the power of AWS for advanced analytics and data-driven decision-making.

Key Responsibilities:

- Design and implement comprehensive data migration strategies from Hadoop to AWS, ensuring minimal disruption to business operations.

- Architect scalable and cost-effective data solutions on AWS, leveraging services such as S3, EMR, Glue, and Redshift.

- Develop and maintain data pipelines using Apache Spark and Python, optimizing them for performance and reliability.

- Collaborate with data engineers and data scientists to understand data requirements and translate them into technical solutions.

- Provide technical leadership and mentorship to junior team members, fostering a culture of innovation and continuous improvement.

- Ensure data quality and security throughout the migration process, adhering to industry best practices and compliance standards.

- Evaluate and recommend new technologies and tools to enhance our data platform capabilities.

Required Skillset :

- Demonstrated ability to design and implement large-scale data migration projects from Hadoop to AWS.

- Must have skills : Hadoop to AWS Migration and Temporal OR AI Harness,

- Experience with AWS (S3, EMR, running Spark jobs on K8s or EKS, Glue, Athena)

- Extensive experience with Apache Spark

- Hands-on experience in Python

- Experience with Apache Airflow

- Experience with Apache Iceberg

- Hands-on experience with the Hadoop stack (YARN, HDFS, Hive) will be a plus