Roles and Responsibilities :

Cluster Architecture & Deployment :

- Design, deploy, and manage RabbitMQ and Kafka clusters across on-premises, cloud, or hybrid environments.

- Configure brokers, exchanges, queues, topics, partitions, replication, and retention policies.

Operation & Monitoring :

- Monitor platform health using tools like Prometheus, Grafana, Kafka Manager, RabbitMQ Management UI, and set up proactive alerting.

- Investigate and troubleshoot issues (e.g., latency, stale messages, downtime).

Security & Compliance :

- Implement access control, authentication (e.g., SASL, Kerberos), encryption (SSL/TLS), and RBAC/ACL policies.

- Enforce data governance and regulatory compliance.

Performance Tuning & Capacity Planning :

- Optimize throughput, latency, and resource usage through fine-tuning broker and pipeline configurations; plan for future scaling capacity.

Automation & Tooling :

- Automate routine tasks using scripting (Shell, Python), IaC tools like Ansible or Terraform, and integrate platforms with CI/CD pipelines.

Disaster Recovery & Resilience :

- Design and maintain backup, restore, and failover strategies to achieve high availability across datacenters or cloud zones.

Collaboration & Support :

- Work with development, DevOps, and data engineering teams to align middleware integration with business requirements.

- Offer guidance, documentation, and knowledge transfer for messaging best practices.

Documentation & Governance :

- Maintain clear records of architecture, configuration standards, incident logs, and operational procedures.

Must Have Skills :

- Overall 7+ years with 3+ years of experience in administering Kafka (Apache, Confluent, MSK) and RabbitMQ in production environments.

- Proven track record in monitoring, optimization, and incident resolution.

- Deep understanding of RabbitMQ and Kafka ecosystems: brokers, connectors, zookeeper/KRaft, schema registry.

- Proficiency with monitoring tools and middleware performance metrics.

- Strong collaboration, communication, and documentation abilities.

- Experience supporting cross-functional teams and mentoring juniors.

- Strong problem-solving skills and attention to detail.