Senior Data Engineer - AWS Cloud

We are seeking a highly experienced Senior Data Engineer to lead the design, development, and optimization of scalable data pipelines using AWS Redshift and Apache Airflow. The ideal candidate will have deep expertise in cloud-based data warehousing, workflow orchestration, and ETL processes, with a strong background in SQL and Python.

Responsibilities :

- Design, build, and maintain robust ETL/ELT pipelines using Apache Airflow.

- Integrate data from various sources into AWS Redshift for analytics and reporting.

- Develop and optimize Redshift schemas, tables, and queries.

- Monitor and tune Redshift performance for large-scale data operations.

- Implement and manage DAGs in Airflow for scheduling and monitoring data workflows.

- Ensure reliability and fault tolerance in data pipelines.

- Work closely with data scientists, analysts, and business stakeholders to understand data requirements.

- Translate business needs into technical solutions.

- Enforce data quality, integrity, and security best practices.

- Implement access controls and audit mechanisms using AWS IAM and related tools.

- Mentor junior engineers and promote best practices in data engineering.

- Stay updated with emerging technologies and recommend improvements.

Requirements :

- Bachelor's or Master's degree in Computer Science, Information Technology, or related field.

- 8+ years of experience in data engineering, with a focus on AWS Redshift and Apache Airflow.

- Strong proficiency in AWS Services : Redshift, S3 Lambda, Glue, IAM.

- Proficient in Programming Languages : SQL, Python.

- Experience with ETL Tools and Frameworks : Apache Airflow, DBT (preferred).

- Experience with data modeling, performance tuning, and large-scale data processing.

- Familiarity with CI/CD pipelines and version control (Git).

- Excellent problem-solving and communication skills.

Preferred Skills :

- Experience with big data technologies (Spark, Hadoop).

- Knowledge of NoSQL databases (DynamoDB, Cassandra).

- AWS certification (e. g., AWS Certified Data Analytics - Specialty).