Software Data Engineer - Python/Spark

Description : Hiring for Data Engineer - Service Based company at Chennai location

Experience : 5+ years

Location : Remote/Hybrid

Notice Period : Should be able to join within 15 days

Responsibilities :

- Ensure data quality through robust validation processes

- Work on data integration and data modeling

- Lead data integration projects and mentor junior engineers

- Collaborate with cross-functional teams to gather data requirements

- Work with data scientists and analysts to optimize data flow for advanced analytics

- Take ownership of modules and deliver high-quality work on time.

Requirements :

- Bachelors degree in Computer Science or related field

- Strong analytical and problem-solving skills

- 5+ years of experience in Data Engineering / Advanced Analytics

- Proficiency in Python

- AWS experience is a strong advantage (ECR, Containerization, Batch, Step Functions 3 yrs)

- Strong SQL and data-warehousing experience

- Hands-on experience with Spark, Pandas, Polars, NumPy, Metaflow

- Experience with GitLab CI/CD or similar tools