We are seeking a highly skilled and motivated AWS Kafka Developer to join our dynamic team. In this role, you will be responsible for designing, developing, and maintaining robust and scalable data streaming solutions using Kafka on AWS. You will collaborate closely with data engineers, software developers, and product managers to build and optimize our data infrastructure, ensuring seamless data flow and real-time analytics capabilities. Your work will directly impact our ability to deliver timely and insightful data to our users, driving better decision-making and improved business outcomes.
Key Responsibilities :
- Design and implement highly scalable and fault-tolerant Kafka clusters on AWS, ensuring optimal performance and reliability for critical data streams.
- Develop and maintain Kafka Streams applications to process and transform real-time data, enabling timely insights and automated decision-making for various business units.
- Deploy and manage Kafka Connectors to integrate diverse data sources and sinks with Kafka, facilitating seamless data ingestion and distribution across the organization.
- Implement robust monitoring and alerting systems for Kafka clusters and applications, proactively identifying and resolving potential issues to minimize downtime and ensure data integrity.
- Collaborate with DevOps teams to automate the deployment and management of Kafka infrastructure using Kubernetes and AWS container services, streamlining operations and improving efficiency.
- Optimize Kafka configurations and performance tuning to meet specific application requirements, ensuring optimal resource utilization and cost-effectiveness.
- Troubleshoot and resolve complex issues related to Kafka clusters, applications, and integrations, providing timely support to internal stakeholders and ensuring business continuity.
Required Skillset :
- Demonstrable ability to design, develop, and deploy Kafka solutions on AWS, including experience with Kafka Streams, Kafka Connect, and AWS services such as EC2, S3, and IAM.
- Proven expertise in containerization technologies like Docker and Kubernetes, with experience deploying and managing Kafka clusters in containerized environments.
- Strong understanding of data streaming concepts and architectures, including experience with real-time data processing, event-driven architectures, and data integration patterns.
- Excellent problem-solving and analytical skills, with the ability to diagnose and resolve complex issues related to Kafka performance, scalability, and reliability.
- Effective communication and collaboration skills, with the ability to work effectively with cross-functional teams and communicate technical concepts to both technical and non-technical audiences.
- Bachelor's or Master's degree in Computer Science or a related field.
- Ability to work independently and collaboratively in a remote/hybrid work environment.