HamburgerMenu
hirist

Lead Data Engineer - Python/Airflow

RANDOMTREES
8 - 10 Years
Remote

Posted on: 21/09/2026

Job Description

Key Responsibilities :

- Design, develop, maintain, and troubleshoot scalable data engineering solutions.

- Develop and troubleshoot Python-based operators, scripts, and data processing workflows.

- Build and optimize SQL queries for data validation, investigation, troubleshooting, and analysis.

- Develop and manage Apache Airflow DAGs for workflow orchestration.

- Design and support batch and streaming data pipelines.

- Implement data ingestion, movement, and integration patterns across multiple systems.

- Work with JSON-based configurations and data processing workflows.

- Apply AI concepts and technologies to data engineering use cases where applicable.

- Collaborate with cross-functional teams to troubleshoot data and pipeline issues.

- Ensure data quality, reliability, and accuracy across ingestion and integration processes.

Must-Have Skills :

- 8+ years of experience in Data Engineering.

- Intermediate-level proficiency in Python with hands-on experience developing operators and scripts.

- Strong SQL skills with experience in data validation, investigation, troubleshooting, and analysis.

- Hands-on understanding of Apache Airflow, including DAGs and workflow orchestration.

- Practical understanding and exposure to AI concepts and applications.

- Experience working with JSON configurations.

- Strong understanding of data ingestion and integration.

- Experience with both batch and streaming data pipelines.

- Understanding of data movement and integration patterns.

SAP Good to Have:

- SAP experience is not mandatory. Candidates with exposure to the following will have an advantage: SAP SLT, SAP S/4HANA data extraction, SAP CDS Views, SAP Extractors, SAP data extraction flows, SAP extraction T-codes.

- SAP knowledge can be supported through client-provided Knowledge Transfer (KT), if required.

Preferred Skills:

- SAP Data Intelligence Graphs, Snowflake, Airflow DAGs, REST/API integration, SQL-based data validation and refresh-metric analysis, experience working with enterprise-scale data integration environments.

Ideal Candidate Profile:

- A strong Data Engineering professional with solid hands-on experience in Python, SQL, Apache Airflow, AI concepts, data ingestion, and integration. SAP experience is an added advantage but is not mandatory.

The job is for:

May work from home
info-icon

Did you find something suspicious?

Similar jobs that you might be interested in

Loading chat...