Description :

Job Description :

We are looking for an experienced Senior Spark Developer with a strong background in Scala, Java, and Big Data technologies.

The ideal candidate will have 5+ years of development experience, including expertise in Spark-based data processing, Java server-side development, and working in fast-paced, low-latency environments. A financial services background is highly desirable.

Key Responsibilities :

- Design, develop, and optimize large-scale data processing applications using Apache Spark with Scala and Java

- Develop and maintain low-latency server-side Java applications

- Work with SQL, UNIX/Linux, and the broader Hadoop ecosystem (HDFS, Hive, HBase, Impala)

- Implement real-time and end-of-day (EOD) data processing using Spark (micro-batching and streaming)

- Collaborate with cross-functional teams to meet delivery goals and timelines

- Contribute to solution design and system architecture discussions

- Write clean, efficient, and testable code following best practices

- Troubleshoot production issues and ensure high availability of applications

Required Skills :

- 5+ years of hands-on development experience

- Expertise in Spark with Scala and Java

- Proficient in SQL and Unix/Linux scripting

- Strong knowledge of Hadoop ecosystem tools (HDFS, Hive, Impala, HBase)

- Experience with Java server-side development in low-latency environments

- Proven problem-solving and analytical skills

- Ability to work under pressure and manage multiple tasks simultaneously

- Strong communication and collaboration skills

Preferred Qualifications :

- Financial services industry experience

- Understanding of real-time data processing concepts and architecture

- Familiarity with Agile methodologies and SDLC best practices

- Enthusiastic, self-motivated, and eager to learn new technologies