Senior Data Engineer - Hadoop

Job Title : Senior Data Engineer Hadoop

Location : Bangalore

Employment Type : Full-time | Onsite

Experience : 8+ Years

Notice Period : Immediate to 15 Days Preferred

Job Overview :

We are looking for a highly skilled Senior Data Engineer with strong hands-on expertise in the Hadoop ecosystem and PySpark for large-scale data processing. The ideal candidate should have deep technical proficiency in distributed data systems and Python-based automation, with a focus on performance and scalability.

Key Responsibilities :

- Design, build, and maintain data pipelines using Hadoop, Spark, and Hive.

- Develop and optimize large-scale ETL/ELT workflows for structured and unstructured data.

- Implement PySpark applications for distributed data processing.

- Automate data ingestion, transformation, and validation using Python.

- Collaborate with data architects, analysts, and business teams to enable analytics and reporting.

- Ensure data reliability, performance tuning, and monitoring across data infrastructure.

Required Skills :

- Strong experience (8+ years) in Data Engineering or Big Data Development.

- Expertise in the Hadoop ecosystem (HDFS, Hive, Spark mandatory).

- Proven experience with PySpark for scalable data processing.

- Solid programming skills in Python for data manipulation and automation.

- Strong understanding of data modeling, performance optimization, and version control (Git).