Kafka Administrator

Description :

Responsibilities :

- Design, build, and manage Kafka clusters using the Confluent Platform for enterprise-grade data streaming solutions.

- Implement Kafka Connect, Kafka Streams, and ksqlDB to develop and manage real-time data pipelines and stream processing applications.

- Monitor, maintain, and optimize Kafka cluster performance, ensuring high availability, fault tolerance, and scalability.

- Develop and maintain Terraform and Ansible scripts to automate Kafka platform setup, configuration, and deployment.

- Implement and manage Kafka security features, including RBAC, ACLs, SSL, and SASL for secure data communication and controlled access.

- Perform capacity planning, troubleshooting, and root cause analysis for Kafka-related issues.

- Collaborate with DevOps, Data Engineering, and Application teams to integrate Kafka with enterprise systems.

- Maintain documentation and best practices for Kafka administration, scaling, and performance tuning.

Requirements :

- Experience : 5+ Years.

- Strong hands-on experience as a Kafka Administrator with Kafka platform setup and cluster management.

- Experience with Confluent Kafka ecosystem (Kafka Connect, Streams, ksqlDB).

- Proficiency in Terraform and/or Ansible for infrastructure automation.

- Good understanding of Kafka security protocols - RBAC, ACLs, SSL, SASL.

- Expertise in monitoring tools such as Confluent Control Center, Grafana, or Prometheus.

Preferred Qualifications :

- Experience with AWS, Azure, or GCP Kafka deployments.

- Knowledge of CI/CD pipelines and container orchestration tools like Docker or Kubernetes.

- Familiarity with Linux system administration and scripting (Bash/Python).

- Confluent Certified Administrator or Developer certification is a plus.