Description :

JOB SUMMARY :

- Strong expertise in Install, configure, and maintain Hadoop ecosystem components (HDFS, YARN, Hive, HBase, Spark, Oozie, Zookeeper, etc.).

- Monitor cluster performance and capacity; troubleshoot and resolve issues proactively.

- Manage cluster upgrades, patching, and security updates with minimal downtime.

- Implement and maintain data security, authorization, and authentication (Kerberos, Ranger, or Sentry).

- Configure and manage Hadoop high availability, disaster recovery, and backup strategies.

- Automate cluster monitoring, alerting, and performance tuning.

- Work closely with data engineering teams to ensure smooth data pipeline operations.

- Perform root cause analysis for recurring system issues and implement permanent fixes.

- Develop and maintain system documentation, including runbooks and SOPs.

- Support integration with third-party tools (Sqoop, Flume, Kafka, Airflow, etc.).

- Participate in on-call rotation and incident management for production support.