Job Description :

Role : Hadoop Administrator

Experience: 3 - 5 years

Location: Ahmedabad

Job Summary:

We are looking for an experienced Hadoop Administrator responsible for installation, administration, monitoring, maintenance, troubleshooting, performance tuning, and high availability of enterprise Hadoop clusters.

The ideal candidate should have strong expertise in setting up Hadoop clusters manually, managing distributed services, ensuring platform availability, and supporting Big Data ecosystems including Logstash, Kafka, Spark, Hive, and related technologies.

Key Responsibilities :

Hadoop Cluster Administration :

- Install and configure Hadoop clusters from scratch (manual deployment without Ambari/Cloudera Manager).

- Deploy and maintain HDFS, YARN, MapReduce, ZooKeeper, Hive, Spark, Kafka, HBase, Oozie and related ecosystem components.

- Configure NameNode, DataNode, ResourceManager, NodeManager and JournalNode services.

- Perform cluster expansion by adding/removing nodes.

- Manage cluster upgrades, patches and migrations.

- Configure High Availability (HA) for Hadoop services.

- Configure Kerberos authentication and cluster security.

- Configure HDFS replication and storage optimization.

- Linux System Experience.

Performance Tuning :

- Optimize Hadoop configuration.

- Tune HDFS performance.

- Tune YARN scheduler configurations.

- Optimize Spark execution.

- Optimize Hive query performance.

- Improve cluster throughput.

- Reduce resource contention.

- Configure memory and CPU allocations.