HamburgerMenu
hirist

Big Data DevOps Engineer - Spark/HBase/Automation Tools

Freelancer Recruiter
5 - 10 Years
rupee20-35 LPA
Any Location

Posted on: 26/03/2026

Job Description

Job Requirements :


- 5+ years of DevOps experience managing the Big Data application stack including HDFS, YARN, Spark, Hive and Hbase

- A deeper understanding of all the configurations required for installing and maintaining the infrastructure in the long run

- Experience setting up high availability, configuring resource allocation, setting up capacity schedulers, handling data recovery tasks

- Experience with middle-layer technologies including web servers (HTTP, ningx), application servers (Jboss, Tomcat), and database systems (Postgres, Mysql)

- Experience setting up enterprise security solutions including setting up active directories, firewalls, SSL certificates, Kerberos KDC servers, etc.

- Experience maintaining and hardening the infrastructure by regularly applying required security packages and patches

- Experience supporting on-premise solutions as well as on AWS cloud

- Experience working with and supporting Spark-based applications on YARN

- Experience with one or more automation tools such as Ansible, Terraform, etc

- Experience working with CI/CD tools like Jenkins and various test report and coverage plugins

- Experience defining and automating the build, versioning, and release processes for complex enterprise products

- Experience supporting clients remotely and on-site

- Experience working with and supporting Java- and Python-based tech stacks would be a plus

info-icon

Did you find something suspicious?

Similar jobs that you might be interested in