Senior Big Data Engineer - PySpark/Scala

Exciting Job Opportunity in Pune!

Are you an experienced Senior Big Data Engineer with over 5 years of expertise? We have a fantastic opportunity waiting for you!

Key Requirements :

- Minimum of 5+ years of experience

- Proficient in Spark development for batch and streaming applications

- Skilled in Pyspark and Data Engineering

- Expert in ETL implementation and migration to Spark

- Strong programming skills in Scala, Java, and Python

- Hands-on experience with Kafka and Spark streaming (Dstream and Structured Streaming)

- Familiar with developer tools like Jupyter notebooks

- Knowledgeable about Airflow or similar workflow engines

Desirable Skills :

- Exposure to Flink and Kudu streaming

- Workflow automation using CI/CD practices

- Understanding of Nifi streaming and transformation

- Experience with Informatica workflow migration