Senior Python/PySpark Developer

Description :

Hiring : Senior Python PySpark Developer

Location : Pune / Chennai

Experience : 5 to 10 Years

Were looking for a skilled Python PySpark Developer to build and optimize large-scale data processing systems across cloud and distributed environments.

Key Responsibilities :

- Build scalable data pipelines using Python & PySpark

- Process large datasets with distributed computing (Spark)

- Optimize performance, memory & scalability of Spark jobs

- Work on batch & near real-time data processing

- Ensure data quality, validation & consistency

What Were Looking For :

- Strong Python + PySpark / Apache Spark experience

- Solid SQL & data engineering fundamentals

- Hands-on with Hadoop ecosystem & data formats (Parquet, Avro, etc.)

- Experience with Airflow (or similar orchestration tools)

- Exposure to AWS / Azure / GCP

Good to Have : Kafka / Spark Streaming, Delta Lake / Iceberg / Hudi, Docker/Kubernetes, BFSI domain