Job Description :

We are seeking an experienced AWS Data Engineer to lead and execute a large-scale migration from Matillion ETL to a modern AWS-native data platform. The ideal candidate will possess deep expertise in Apache Airflow, AWS Glue, AWS Lambda and Snowflake, with a strong background in designing scalable data pipelines, cloud-based data integration, workflow orchestration, and data warehouse modernization.

Total Experience : 2 - 5 years

Key Responsibilities :

- Develop modules/code for migration of existing Matillion jobs to AWS-native solutions.

- Participate in Requirements Analysis of existing data processing jobs.

- Design, develop, and promote scalable data pipelines using AWS Glue and Apache Airflow.

- Build robust data ingestion, transformation, and orchestration frameworks on AWS.

- Create reusable and modular ETL/ELT components for enterprise data platforms.

- Implement data quality, monitoring, alerting, security, governance, and compliance standards.

- Collaborate with data architects and business teams to understand migration requirements and translate them into technical solutions.

- Optimize data processing performance, cost, and scalability across AWS services.

- Participate in CI/CD best practices and DevOps processes for data engineering workflows.

Tech Stack :

- Apache Airflow (DAG development, workflow orchestration, scheduling, monitoring)

- AWS Glue (ETL jobs, Glue Studio, Crawlers, Data Catalog, Spark-based transformations)

- Snowflake (Data Warehousing, SnowSQL, Snowpipe, Streams & Tasks, Performance Tuning)

- AWS Lambda and Step Functions

- Programming language s: Python, SQL, Spark

- Git experience