Job Description :

Job Summary :

We are seeking a highly skilled Big Data Engineer with strong expertise in Scala, along with solid experience in Java 8, Python (PySpark), and Hadoop architecture. The ideal candidate should possess advanced problem-solving abilities and a strong foundation in building scalable data processing systems.

Key Responsibilities :

- Design, develop, and optimize large-scale data processing pipelines using Scala.

- Work with distributed systems and Hadoop ecosystem components to handle big data workloads.

- Write efficient, reusable, and scalable code in Java 8 and Python (PySpark).

- Apply advanced logic-building skills to solve complex data engineering problems.

- Collaborate with cross-functional teams including data scientists, analysts, and product teams.

- Ensure data quality, performance tuning, and reliability of data pipelines.

- Participate in code reviews, testing, and deployment processes.

Required Skills :

- Strong hands-on experience with Apache Spark (Scala & PySpark)

- Proficiency in Scala programming

- Experience with Java 8 (good to have)

- Strong advanced logic-building and problem-solving skills

- Expertise in Python (PySpark)

- In-depth understanding of Hadoop Architecture and ecosystem (HDFS, YARN, MapReduce)