- Sound knowledge of Apache Kafka Configuration and Pub/Sub Integration, Java, Microservices

Desired Competencies (Technical/Behavioral Competency)

Must-Have :

- Developing scripts/code for Kafka Connector

- Developing scripts/code for Kstream

- Developing Publisher and Subscriber for Kafka Topics

- Configure Kafka topics with Different consumer groups and Partitions

- Setting up Kafka cluster and security for Kafka cluster

- Develop Java Code, Spring/Spring Boot microservices, SQL and UNIX scripts

Good-to-Have :

- Experience in Agile development environment

- Experience in BFSI Domain, specifically corporate banking

Responsibility/Expectations :

- Engage with the customer to understand the requirements, provide technical solutions, provide value added suggestions

- Help build and manage the team of Kafka and Java developers in the near future.

Key Skills/Knowledge :

- Engineer having competencies like Apache Beam, GCP Cloud, Open Shift

- Should have experience in Java and Kafka Streaming. GCP and Kubernetes knowledge nice to have.

- Develop and Deploy data and analytics-led solutions on GCP

- Experience designing highly available and scalable systems

- Hands-on of Data Engineering solutions using Cloud BigQuery, Cloud DataFlow, Cloud BigTable, Storage, Cloud Spanner, Cloud IAM

- Understanding of Apache Kafka

- Proficiency in cloud based ETL/Data Orchestration tools like Apache Beam, Cloud composer

- Experience in Stack driver logging/monitoring

- Experience in Python is a MUST

- Hands-on experience with Apache spark and its components(Streaming) is a strong advantage

- Experience with automation tools such as Ansible, Terraform

- Familiar with containers like Kubernetes, Docker, Helm