Shift : 2:00 PM - 11:00 PM IST

Experience : 6+ years of hands-on Data Engineering experience

About the Role :

We are looking for experienced Data Engineers who can design, build, and optimize large-scale data pipelines. This role is for individual contributors who love coding, problem-solving, and working with cutting-edge big data technologies.

Key Responsibilities :

- Design, develop, and maintain scalable data pipelines for ETL processes using Spark (PySpark/Scala).

- Optimize data flow and automate existing processes for improved performance.

- Collaborate with cross-functional teams - Data Science, Analytics, and Product - to support data infrastructure needs.

- Work on data quality, reliability, and performance improvements.

- Handle large datasets from multiple sources (structured & unstructured).

Required Skills & Experience :

- 6+ years of experience as a Data Engineer working in big data environments.

- Strong programming experience in Scala and/or PySpark.

- Hands-on experience with Apache Spark, Databricks, and cloud-based data architectures.

- Solid knowledge of SQL and relational databases (Postgres, MySQL, etc.).

- Experience with file formats like Parquet, Delta Tables, CSV, JSON.

- Comfortable working in a Linux shell environment.

- Strong communication and problem-solving skills.

Good to Have :

- Experience in machine learning data pipelines.

- Working knowledge of Agile environments and CI/CD data workflows.