Senior Lead Data Engineer

About Client :

It partners with major firms in banking, healthcare, telecom, and media. Our Client is known for combining deep industry expertise with agile development practices, enabling scalable and cost-effective digital transformation.

The company operates in over 50 locations across more than 25 countries, has delivery centers in Asia, Europe, and North America and is backed by Baring Private Equity Asia.

Job Title : Data engineering and ETL development.

Key Skills :

- ETL, SSIS, SQL, Python, CKGL, and SAP.

- Assist in ETL pipeline creation,SSIS packages and Python scripts,SQL,.

Job Locations : Pan India.

Experience : 8 - 11 Years.

Education Qualification : Any Graduation.

Work Mode : Hybrid.

Employment Type : Contract.

Notice Period : Immediate.

Job Description :

Job Title : Senior Lead Software Engineer -Data engineering and ETL development.

About the Job :

- Experience in ETL, SSIS, SQL, Python with PySpark.

- Assist in ETL pipeline creation, defect tracking, and framework maintenance under the guidance of the onshore lead.

Required Skills & Qualifications :

- 4 - 6 years of hands-on experience in data engineering, MLOps, or cloud-native ML/AI systems.

- Proficiency in Python with experience in writing production-grade code.

- Strong experience with AWS services : SageMaker, Glue, Lambda, ECS/EKS, CloudFormation/Terraform, CloudWatch, Step Functions, S3, Redshift, Athena

- Experience with CI/CD tools : Git, GitHub/GitLab, Jenkins, AWS CodePipeline.

- Hands-on with Docker and container orchestration.

- Experience working with Apache Spark / PySpark for large-scale data processing.

- Solid understanding of machine learning lifecycle (training, validation, deployment, monitoring).

- Strong SQL skills and experience working with large datasets.

Preferred Qualifications :

- Experience with Kubeflow, MLflow, or similar MLOps frameworks.

- Familiarity with Kafka, Airflow, or Apache NiFi for orchestration.

- AWS Certifications (e.g., AWS Certified Machine Learning Specialty, AWS Data Analytics, or Solutions Architect).

- Exposure to data governance, data privacy, and compliance frameworks.

- Prior experience in Agile/Scrum environment.