Job Title : Kafka Engineer/Lead

Location : Hyderabad

Position : Full Time

Work Timings : 24/7 Working in a SODC Environment.

Job Summary : A Confluent Kafka Support Engineer is responsible for providing technical support, troubleshooting, and expert guidance for customers using Apache Kafka and the Confluent Platform. The role involves resolving production issues, optimizing performance, and ensuring the reliability of distributed streaming systems.

Role and Responsibilities :

1. Customer Support & Issue Resolution :

- Provide L2/L3 technical support for Kafka-based systems.

- Troubleshoot cluster, broker, producer, and consumer issues.

- Diagnose and resolve performance bottlenecks, latency issues, and data inconsistencies.

- Handle incidents and ensure SLA adherence.

2. Kafka & Confluent Platform Expertise :

- Support and maintain Apache Kafka clusters and Confluent Platform components (Schema Registry, Kafka Connect, ksqlDB, Control Center).

- Assist customers with topic configurations, partitioning strategies, and replication and fault tolerance.

3. Debugging & Root Cause Analysis :

- Conduct deep-dive investigations into system failures.

- Use logs, metrics, and traces to identify root causes.

- Provide post-mortem reports and preventive recommendations.

4. Automation & Process Improvement :

- Automate operational tasks using Python, Shell scripts, Ansible, Terraform.

- Develop runbooks, SOPs, and knowledge articles.

- Continuously improve support processes and efficiency.

Required Skills :

- 5-8 years of experience working with Apache Kafka and Confluent Kafka.

- Strong knowledge of Kafka internals (brokers, zookeepers, partitions, replication, offsets).

- Experience with Kafka Connect, Schema Registry, REST Proxy, and Kafka security.

- Hands-on experience with AWS (EC2, IAM, CloudWatch, S3, Lambda, VPC, Load balancers).

- Proficiency in scripting and automation using Terraform, Ansible, or similar tools.

- Familiarity with DevOps practices and tools (CI/CD pipelines, monitoring tools like Prometheus/Grafana, Splunk, Datadog etc).

- Experience with containerization (Docker, Kubernetes) is a plus.

Nice to Have :

- Confluent Certified Developer or Administrator.

- AWS Certified.

- CICD (AWS Code Pipeline, Harness).

- Containers (Docker, Kubernetes).

Key Skills : Confluent, Kafka, AWS, Terraform