Data Engineer - Hadoop Ecosystem

Description :

We are looking for a highly skilled Senior Data Engineer (Hadoop) to join our team in Bangalore.

The ideal candidate will design, develop, and optimize data solutions within the Hadoop ecosystem, ensuring high performance, scalability, and data quality across enterprise-level platforms.

Responsibilities :

- Develop scalable ETL pipelines using PySpark and Hadoop components.

- Optimize existing data flows for performance and reliability.

- Collaborate with Data Science and Analytics teams to support business use cases.

- Automate repetitive data engineering tasks using Python.

- Ensure best practices in data management, version control, and documentation.

Key Skills & Expertise:

- Strong hands-on experience in Hadoop ecosystem HDFS, Hive, Spark, etc.

- PySpark expertise for large-scale distributed data processing (Mandatory)

- Proficiency in Python for data manipulation and automation

- Experience building and optimizing data pipelines and workflows

- Strong analytical and problem-solving abilities