Procorp Systems - Senior Data Engineer - AWS/Apache Airflow

Job Title : Senior Data Engineer AWS Redshift & Airflow

Location : Hyderabad

Employment Type : Full-Time / Contract (Both options available)

Experience Required : 4- 8 years

Key Responsibilities :

- Leverage AWS services such as IAM, S3, API Gateway, Lambda, Glue, Lake Formation, Redshift, DynamoDB, and RDS for data engineering solutions.

- Build and orchestrate analytics workflows using Apache Airflow.

- Develop automation scripts and manage infrastructure using Terraform or CloudFormation.

- Ensure data quality, security, profiling, and compliance across data pipelines.

- Integrate and optimize data warehousing solutions using AWS Redshift.

- Collaborate with BI teams and business stakeholders to deliver actionable insights.

- Manage source code, CI/CD, and DevOps practices using GitLab, Bitbucket, or similar tools.

- Support existing ETL solutions and migrate workloads to modern cloud-based data platforms.

- Research, evaluate, and adopt new tools and technologies to improve data engineering capabilities.

- Provide mentorship and technical guidance to junior engineers.

Core Skills & Requirements :

- Strong proficiency in Python for building and optimizing data pipelines.

- 2+ years of hands-on experience with Apache Airflow for orchestration.

- Experience with IaC tools such as Terraform or AWS CloudFormation.

- Solid knowledge of data warehousing concepts, BI solutions, and performance tuning.

- Familiarity with traditional ETL tools such as Talend, Informatica, or Pentaho.

- Understanding of data security best practices and compliance frameworks.

- Exposure to AWS EKS and Kubernetes cluster setup/management (preferred).