Role Overview :

We are looking for an experienced Kafka CDC Engineer with strong hands-on expertise in Apache Kafka, Kafka Connect, Debezium CDC, and Oracle. The candidate will be responsible for implementing and supporting real-time Change Data Capture (CDC) pipelines, enabling data movement from Oracle databases to Kafka and downstream platforms such as Databricks/Data Lakes.

Key Responsibilities :

- Implement and configure Debezium CDC for capturing changes from Oracle 19c/21c logs and APIs.

- Configure Kafka Connect and Debezium connectors for Oracle-to-Kafka data pipelines.

- Design and configure Apache Kafka topics to capture and distribute database change events.

- Manage CDC event flow from Oracle tables to Debezium to Kafka topics to downstream systems.

- Integrate Kafka CDC pipelines with Databricks, Data Lake, and other downstream data platforms.

- Handle schema evolution, data validation, data consistency, and transformation requirements.

- Monitor Kafka topics, connectors, consumer/producer activity, and CDC pipelines in production.

- Troubleshoot production incidents related to Kafka, Debezium, Kafka Connect, Oracle connectivity, offsets, lag, and data discrepancies.

- Perform root-cause analysis and implement permanent fixes for production issues.

- Optimize Kafka and CDC pipeline performance, throughput, and reliability.

- Develop and maintain SQL/PLSQL and Shell scripts for data validation, automation, and operational activities.

- Work with Linux environments for deployment, monitoring, troubleshooting, and automation.

- Collaborate with application, database, cloud, and data engineering teams.

Mandatory Skills :

- 5 - 8 years of relevant experience in Data Engineering / Streaming / CDC.

- Strong hands-on experience with Apache Kafka, Debezium CDC, and Kafka Connect.

- Experience implementing Oracle-to-Kafka CDC pipelines.

- Strong understanding of Kafka topics, partitions, offsets, producers, consumers, and event processing.

- Experience with Oracle 19c/21c and strong SQL/PLSQL skills.

- Good experience with Linux and Shell Scripting.

- Experience in production support, incident management, troubleshooting, and RCA.

Preferred Skills :

- Databricks, Data Lake, AWS, Kubernetes, Confluent Platform, CI/CD.

- Experience with Kafka monitoring and performance tuning.