Big Data & Hadoop Administration :

- Deploy and administer Hadoop distributions such as Hortonworks, Cloudera, and Apache Hadoop/Spark ecosystem

- Manage and maintain components such as :

1. HDFS, YARN

2. Apache Kafka, Apache NiFi

3. Apache HBase, Apache Spark

4. Apache ZooKeeper, Apache Solr

5. Redis, and other ecosystem services

- Use tools like Ambari, Cloudera Manager, or other monitoring platforms for cluster health and performance management

- Perform capacity planning and maintenance for HBase and Solr clusters

- Ensure high availability, reliability, and performance of big data applications

- Collaborate with application, database, and network teams for seamless infrastructure integration

Linux & System Administration :

- Install, configure, and maintain Linux operating systems

- Manage network configurations, system performance, and troubleshooting

- Handle system-level issues that impact big data services

Scripting & Automation :

- Develop and maintain Unix Shell scripts and Ansible playbooks for process automation and system provisioning

- Automate regular administrative tasks to improve efficiency and reduce manual overhead

Customer Interaction & Support :

- Work directly from customer locations, providing on-site technical support and issue resolution

- Coordinate with QA and Engineering teams for escalations and bug resolution

- Ensure timely issue handling and resolution aligned with SLA commitments

Virtualization :

- Administer and manage KVM virtualization environments for virtual machine provisioning and resource management

Required Qualifications :

- Proven experience with Hadoop ecosystem deployment, configuration, and troubleshooting

- Solid understanding of Linux system administration, shell scripting, and network management

- Experience managing large-scale distributed systems and services

- Hands-on experience with tools like Ambari, Cloudera Manager, and monitoring solutions

- Good knowledge of scripting languages like Shell, Ansible, or Python

- Understanding of KVM virtualization concepts and administration

- Strong problem-solving skills and attention to detail

- Good communication and interpersonal skills to work effectively with customers and internal teams

Preferred Qualifications :

- Prior experience working on-site at customer locations

- Exposure to DevOps tools and practices

- Knowledge of cloud-based big data deployments (AWS, Azure, GCP)

- Experience in performance tuning, backup strategies, and security hardening for Hadoop clusters