Capco - Hadoop Administrator

Position : Hadoop Admin

Experience : 5 - 10 Years

Location : Bangalore, India

Work Model : Hybrid

Job Summary :

We're looking for an experienced Hadoop Admin with 5 -10 years of experience to join our Big Data team. The ideal candidate will be a skilled professional responsible for managing and engineering our Hadoop platforms, with a strong focus on improving performance, reliability, and efficiency. This role requires a blend of hands-on Hadoop administration expertise, DevOps skills, and a knack for automation. You will be working during India Standard Time (IST) hours in a hybrid role.

Key Responsibilities :

Platform Administration & Engineering :

- Perform administrative and engineering activities on multiple open-source platforms, including Hadoop, Kafka, HBase, and Spark.

- Plan and execute capacity expansions and upgrades to prevent scaling issues and bugs.

Automation & DevOps :

- Develop and implement automation for repetitive tasks using tools and languages like Ansible, Shell scripting, or Python scripting to reduce manual effort and human error.

- Leverage DevOps tools and principles, including Incident, Problem, and Change Management, in day-to-day operations.

Performance & Reliability :

- Focus on enhancing the performance, reliability, and efficiency of Big Data platforms.

- Tune alerting systems and set up observability to proactively identify issues and performance problems.

- Identify and implement high-availability solutions for services with single points of failure.

Troubleshooting & Documentation :

- Possess strong troubleshooting and debugging skills to effectively perform root cause analysis for major production incidents.

- Create standard operating procedure documents and guidelines for effective platform

management.

Security & Compliance :

- Ensure the Hadoop platform meets performance and service level agreement requirements.

- Perform security remediation, automation, and self-healing as required.

Collaboration :

- Work closely with Level-3 teams to review new use cases and cluster hardening techniques.

- Create reports and automation to minimize manual effort and improve operational efficiency.

Required Skills & Qualifications :

Core Experience : 5 -10 years of hands-on experience in Hadoop administration.

Technical Proficiency :

- Expertise in Hadoop administration.

- Strong automation skills with Ansible, Shell scripting, or Python scripting.

- Proficiency in at least one programming language, preferably Python, and a solid

understanding of DevOps practices.

Professional Attributes :

- Strong troubleshooting and debugging skills.

- The ability to perform effective root cause analysis.

- A focus on improving platform performance, reliability, and efficiency.