Job Role : Hadoop Administrator (Role open for multiple locations) - WFH and WFO

Job description :

What is your Role ?

- You will manage Hadoop clusters, data storage, server resources, and other virtual computing platforms.

- You perform a variety of functions, including data migration, virtual machine set-up and training, troubleshooting end-user problems, and designing assessment tools for storage and visualization applications.

- They must be able to design, build, and maintain systems in both cloud and physical environments.

- Big Data Engineers must also be able to collaborate with other IT professionals, including software engineers, system administrators, and development teams.

- You will be able to implement, monitor and maintain Hadoop systems in both cloud and physical environments.

- You will be deputed at customer premises to assist customers with issues related to Hadoop Infrastructure, Software Infrastructure and Application Software (Products) deployed.

- Need to work as a developer in Cloudera Hadoop.

- Work on Hadoop, Python, PySpark, Hive SQLs, Bigdata Eco System Tools.

- Experience in working with teams in a complex organization involving multiple reporting lines.

- The candidate should have strong functional and technical knowledge to deliver what is required and he/she should be well acquainted with Banking terminologies.

- The candidate should have strong DevOps and Agile Development Framework knowledge.

- Create Python/PySpark jobs for data transformation and aggregation.

- Experience with stream-processing systems like Spark-Streaming.

What will you do ?

- Deploying a Hadoop cluster, maintaining and administration of a Hadoop cluster, adding and removing nodes using cluster monitoring.

- Performance monitoring of Hadoop components and optimization.

- Create and manage VMs, installation of VM tools, custom virtual hardware provisioning as per guest OS.

- Design automates scripts to improve efficiency, operational stability and operational integrity using PowerShell and Ansible.

- Monitor system performance, identify issues, and perform troubleshooting activities.

- Ensure the system documentation is up to date.

- Collaborate with IT professionals in other departments.

- Participate in system design, code reviews, and other development activities.

- Maintain and improve system availability, scalability, and reliability.

- Research, evaluate, and recommend new technologies.

- Stay updated with industry developments and emerging technologies.

Technical skills required :

- Technical Domain: Linux, Big Data, Apache Hadoop, Virtualization, KVM, OLVM, Vmware, Ansible, System Administration.