HamburgerMenu
hirist

Senior Data Engineer - ETL/Data Warehousing

AgileWaters
Multiple Locations
6 - 12 Years

Posted on: 06/11/2025

Job Description

Description :

Job Title : Senior Data Engineer (Kafka & AWS)

Responsibilities :


- Develop and maintain real-time data pipelines using Apache Kafka (MSK or Confluent) and AWS services.

- Configure and manage Kafka connectors, ensuring seamless data flow and integration across systems.

- Demonstrate strong expertise in the Kafka ecosystem, including producers, consumers, brokers, topics, and schema registry.

- Design and implement scalable ETL/ELT workflows to efficiently process large volumes of data.

- Optimize data lake and data warehouse solutions using AWS services such as Lambda, S3, and Glue.

- Implement robust monitoring, testing, and observability practices to ensure reliability and performance of data platforms.

- Uphold data security, governance, and compliance standards across all data operations.

Requirements :

- Minimum of 5 years of experience in Data Engineering or related roles.

- Proven expertise with Apache Kafka and the AWS data stack (MSK, Glue, Lambda, S3, etc.).

- Proficient in coding with Python, SQL, and Java with Java strongly preferred.

- Experience with Infrastructure-as-Code (IaC) tools (e.g., CloudFormation) and CI/CD pipelines.

- Excellent problem-solving, communication, and collaboration skills.

- Flexibility to write production-quality code in both Python and Java as required.

Skills :

- Aws

- Kafka

- Python


info-icon

Did you find something suspicious?