Iris Software - Senior Data Engineer - Python/PySpark

Job Description :

We are looking for an experienced Senior Data Engineer to design, build, and maintain scalable ELT/ETL pipelines and cloud-based data platforms in a Data Lake/Data Warehouse environment.

Key Responsibilities :

- Design and develop resilient ELT/ETL data pipelines on cloud platforms

- Build and optimize data processing using Python, SQL, PySpark

- Ensure data quality, governance, and reliability across pipelines

- Deploy and manage solutions using AWS services (S3, Glue, EMR, Athena, Lambda, SNS, SQS, EC2, VPC)

- Implement CI/CD pipelines and follow DevOps best practices

- Collaborate with stakeholders and mentor junior engineers

Required Skills :

- Expert hands-on experience with Python, SQL, PySpark

- Solid understanding of Data Lakes and Data Warehouses

- Hands-on experience with AWS data & compute services

- Experience with Data Governance, Data Quality frameworks

- Proficiency in Jenkins, CI/CD, Git-based source control