Hadoop Administrator - Red Hat/CentOS

Job Summary :

We are looking for an experienced Hadoop Administrator with 4+ years of hands-on experience in managing and supporting Hadoop ecosystems. The ideal candidate will have deep expertise in Unix-based system administration, Cloudera and Hortonworks distributions, and configuring secure and highly available Hadoop clusters in both on-premise and cloud environments. You will be responsible for ensuring the reliability, security, and performance of big data platforms while collaborating with cross-functional teams to support enterprise-level data initiatives.

Roles & Responsibilities :

- Deploy, configure, and manage Hadoop ecosystems (Cloudera CDP/CDH, Hortonworks HDP) across on-premises and cloud environments.

- Perform system administration tasks on Linux-based platforms (RedHat, CentOS, Ubuntu).

- Set up and configure Hadoop services such as HDFS, YARN, Zookeeper, Hive, Spark, HBase, etc.

- Implement and manage Kerberos-based authentication and data-at-rest encryption for Hadoop clusters.

- Manage and troubleshoot data replication peers and policies across environments.

- Set up and maintain security frameworks such as Ranger, Atlas, and SSL configurations.

- Monitor and audit Hadoop environments and ensure data integrity, availability, and compliance.

- Utilize shell scripting, bash, and Python for automation, cluster configuration, and monitoring.

- Support the platform deployment using AWS cloud-native services.

- Participate in a 24x7 rotating support model, including weekends and public holidays.

- Collaborate with infrastructure, networking, and development teams for platform maintenance and upgrades.

- Use Hadoop CLI for routine cluster operations and troubleshooting tasks.

Key Skills Required :

- Hadoop Administration (CDP/CDH/HDP)

- Unix/Linux OS (RedHat, CentOS, Ubuntu)

- Hadoop Services : HDFS, YARN, Hive, Spark, HBase, Zookeeper

- Kerberos, Ranger, SSL, Atlas

- Scripting (Shell/Bash, Python)

- Data encryption (at-rest and in-transit)

- Cloud Platforms : AWS (Cloud-native deployment)

- 24x7 Production Support