AWS Architect

Primary Skills (Must Have) :

- AWS Architecture 60%

- RDS, Aurora, DynamoDB, Redshift 20%

- Storage : S3 and Integration : API Gateway, Event Bridge

- Security : IAM, Secrets Manager

- Monitoring : CloudWatch 20%

- GCP

- Support RFPs, proposals, and technical solutioning

- Experience Range : 10 years of experience in data architecture and AWS data engineering Key

Responsibilities :

- Design and implement scalable data architectures on AWS, leveraging services such as EMR, Redshift, DynamoDB, and Kinesis

- Develop robust data pipelines using Spark (Scala), Oozie, and AWS Glue to support analytics and operational workloads

- Configure and optimize AWS services including Athena, Open Search, CloudWatch, Macie, and CloudFormation for efficient data processing and monitoring

- Manage and secure data flows with Amazon SNS, SQS, API Gateway, and DMS, ensuring data integrity and compliance

- Collaborate with cross-functional teams to translate business requirements into technical solutions, focusing on performance, security, and reliability

- Troubleshoot and resolve complex issues related to data ingestion, transformation, and storage within AWS environments

- Implement best practices for data governance, security, and privacy, utilizing AWS Macie and related tools

- Monitor system performance and proactively identify opportunities to improve data processing efficiency and reduce costs

Required Skills :

- Advanced proficiency with AWS services including Athena, SNS, SQS, CloudWatch, Macie, Kinesis, CloudFormation, EMR, Open Search, DynamoDB, Amazon API Gateway, SCT, Redshift, and DMS

- Expertise in Spark with Scala for large-scale data processing

- Hands-on experience with Oozie for workflow orchestration

- Strong knowledge of data modelling and architecture in cloud environments

- Proficiency in designing and optimizing ETL pipelines

- Experience with real-time and batch data processing solutions

- Ability to configure and manage AWS security and monitoring tools

- Skilled in deploying infrastructure as code using AWS CloudFormation

- Competence in integrating AWS services for end-to-end data solutions

- Solid understanding of data governance and compliance in AWS

Preferred Skills :

- Experience with machine learning pipelines on AWS

- Knowledge of advanced AWS analytics services such as AWS Glue and Quick Sight

- Familiarity with containerization technologies like Docker and Kubernetes

- Expertise in automating data quality and validation processes

- Background in implementing data cataloguing and lineage solutions

- Experience with migration tools and strategies for legacy data systems

Desired Qualifications :

- AWS Certified Data Analytics Specialty or AWS Certified Solutions Architect certification preferred