Key Responsibilities :

- Deploy, configure, and administer Hortonworks, Cloudera, and Apache Hadoop/Spark ecosystem components.

- Install and manage Linux operating systems and networking configurations on servers.

- Develop automation scripts using Unix Shell and Ansible to streamline operational tasks.

- Maintain core big data components including Zookeeper, Kafka, NiFi, HDFS, YARN, Redis, Spark, HBase, Solr, and others.

- Oversee daily operations of Hadoop clusters using tools such as Ambari, Cloudera Manager, and other monitoring platforms to ensure cluster availability and performance.

- Manage HBase and Solr clusters with a focus on capacity planning and performance tuning.

- Collaborate with database, network, and application teams to ensure high availability and optimal performance of big data applications.

- Provide technical support and troubleshooting assistance, including deputation to customer premises as needed.

- Manage KVM virtualization environments supporting big data infrastructure.

- Communicate effectively with internal teams and customers to coordinate issue resolution within SLA timelines.

Qualifications & Skills :

- Proven experience in system administration and Hadoop ecosystem management.

- Strong knowledge of Linux operating systems, networking, and server management.

- Hands-on experience with Hadoop distributions such as Hortonworks and Cloudera.

- Proficiency in scripting languages such as Unix Shell and automation tools like Ansible.

- Experience managing big data components including Zookeeper, Kafka, NiFi, HDFS, YARN, Redis, Spark, HBase, and Solr.

- Familiarity with cluster management and monitoring tools such as Ambari and Cloudera Manager.

- Knowledge of virtualization technologies, especially KVM.

- Excellent problem-solving and troubleshooting skills.

- Strong communication skills and ability to work effectively with customers and cross-functional teams.

- Willingness to work on-site at customer locations as required.