Big Data Developer - Scala/Apache Spark

Job Title : Big Data Developer

Work Location : Chennai, TN / Pune, MH / Mumbai, MH

Experience : 8- 10 Years in Big Data & Hadoop Ecosystem (Minimum 6+ years overall)

Employment Type : Contract 6 Months (Extendable)

Job Overview :

We are seeking an experienced Big Data Developer with strong expertise in the Hadoop ecosystem and hands-on experience in Scala, Spark, Hive, MapR, and Python. The ideal candidate will have a strong foundation in object-oriented programming, experience building enterprise-grade data solutions, and the ability to work effectively in a fast-paced environment.

This role focuses on developing, optimizing, and maintaining scalable big data processing solutions to support large-scale data analytics and business intelligence needs.

Key Responsibilities :

- Design, develop, and maintain big data applications using Scala and Apache Spark.

- Build and optimize data pipelines for batch and large-scale data processing.

- Work with the Hadoop ecosystem, including HDFS, Hive, Spark, and MapR.

- Develop and enhance enterprise-level software solutions following object-oriented design principles and patterns.

- Perform data transformations, aggregations, and validations to ensure data quality and consistency.

- Collaborate with data engineers, architects, and business teams to understand data requirements and deliver solutions.

- Conduct performance tuning and optimization of Spark jobs and Hive queries.

- Perform quick research and problem-solving using available resources to address technical challenges.

- Document technical designs, workflows, and development standards.

- Present technical information clearly and concisely to stakeholders and team members.

Must-Have Skills & Qualifications :

- 8- 10 years of experience in Big Data development (Minimum 6+ years overall experience).

- Strong proficiency in Scala (certification from an accredited institution is preferred).

- Hands-on experience with Apache Spark, Hive, HDFS, and MapR.

- Solid understanding of Object-Oriented Programming (OOP) concepts and design patterns.

- Experience building enterprise-scale software solutions.

- Strong analytical and problem-solving skills.

- Ability to quickly research, learn, and apply new concepts.

- Strong communication skills with the ability to present information clearly.

Good-to-Have / Preferred Skills :

- Basic knowledge of Java or other object-oriented programming languages.

- Experience with scripting languages such as Unix/Shell or Python.

- Exposure to data ingestion and processing workflows.

- Experience working in distributed computing environments