Senior Data Engineer - Spark/Python

Job Title : Senior Data Engineer

Location : Remote (Pan India)

Shift Timings : 2 : 00 PM - 11 : 00 PM IST

Employment Type : Full-Time, Permanent

Reporting To : CEO or assigned Lead

Responsibilities :

- Identify, design, and implement process improvements (automation, optimization, scalability).

- Collaborate with stakeholders across Executive, Product, Data, and Design teams for data infrastructure support.

- Work with ML, data, and analytics experts to enhance innovation, accuracy, and system functionality.

Qualifications :

- 10+ years of recent experience as a Data Engineer.

- 5+ years of recent experience with Apache Spark.

- Strong Big Data and distributed systems knowledge.

- Proficient in Scala, Python, Java (multi-language switching capability).

- Advanced SQL skills; experience with Postgres/MySQL.

- Cloud experience with Databricks.

- Experience with data formats : Delta Tables, Parquet, CSV, JSON.

- Proficient in Linux shell scripting.

- Agile environment experience.

- ML knowledge is a plus.

- Strong independent work capability, delivering stable and efficient solutions.

- Excellent English communication skills.

- Experience working in dynamic, cross-functional teams.