Technical Competencies :

- Hadoop Cluster Administration (Installation, Configuration, Maintenance)

- HDFS Management and Optimization

- YARN Resource Management

- MapReduce Job Monitoring and Troubleshooting

- Hive Administration and Performance Tuning

- Spark Cluster Administration

- Kafka Administration and Monitoring

- HBase Administration

- Sqoop / Oozie Workflow Management

- ZooKeeper Configuration and Maintenance

- Cloudera Manager / Ambari Administration

- Linux Server Administration (RHEL, CentOS, Ubuntu)

- Shell Scripting / Python Automation

- Cluster Performance Tuning and Capacity Planning

- High Availability (HA) and Disaster Recovery (DR)

- Backup, Restore, and Patch Management

- Kerberos Authentication

- Ranger / Knox Security Administration

- LDAP / Active Directory Integration

- SSL Certificate Management

- Monitoring Tools (Grafana, Nagios, Splunk, Prometheus)

- Log Analysis and Incident Troubleshooting

- Storage & Network Troubleshooting

- Cloud Platform Exposure (AWS / Azure / GCP)

- DevOps Tools exposure (Ansible, Jenkins, Git)

- Documentation and SOP Management.

Job Description :

We are looking for an experienced Hadoop Administrator to manage, maintain, and optimize large-scale Hadoop clusters in production environments. The ideal candidate will have strong expertise in Hadoop ecosystem administration, cluster performance tuning, security implementation, and troubleshooting. This role requires hands-on experience in ensuring high availability, scalability, and smooth operations of big data platforms.

Key Responsibilities :

- Install, configure, administer, and support Hadoop clusters (multi-node production environments).

- Manage Hadoop ecosystem components such as HDFS, YARN, Hive, HBase, Sqoop, Oozie, Kafka, Spark, and ZooKeeper.

- Monitor cluster health, performance, capacity planning, and resource utilization.

- Perform upgrades, patching, backup, recovery, and disaster recovery planning.

- Implement security using Kerberos, Ranger, Knox, LDAP/AD integration.

- Troubleshoot cluster issues related to nodes, storage, network, jobs, and performance bottlenecks.

- Configure and maintain high availability for NameNode, ResourceManager, and other critical services.

- Automate routine administration tasks using Shell scripting, Python, or Ansible.

- Support developers and data engineers in job deployments and performance optimization.

- Maintain operational documentation, SOPs, and best practices.

- Work closely with infrastructure, cloud, and DevOps teams for platform stability.

Required Skills :

- Strong hands-on experience in Hadoop Administration.

- Expertise in HDFS, YARN, MapReduce, Hive, Spark, Kafka, HBase.

- Experience with Cloudera / Hortonworks / Apache Hadoop distributions.

- Good knowledge of Linux administration (RHEL/CentOS/Ubuntu).

- Strong scripting skills in Shell / Python.

- Experience with monitoring tools like Ambari, Cloudera Manager, Grafana, Nagios, Splunk.

- Knowledge of Kerberos, Ranger, Knox, SSL, data security practices.

- Experience in cluster tuning, workload management, and troubleshooting.

- Familiarity with cloud platforms (AWS / Azure / GCP) is an advantage.

- Good communication and stakeholder management skills.

Preferred Qualifications :

- Bachelors degree in Computer Science, IT, or related field.

- Hadoop / Cloudera certifications preferred.

- Experience in enterprise production support environments.