Job Description :

Key Responsibilities :

- Design, develop, and maintain scalable data pipelines for processing large volumes of structured and unstructured data.

- Build and optimize real-time data streaming solutions using Apache Kafka.

- Develop data ingestion, transformation, and integration processes using Python and SQL.

- Work closely with data architects, analysts, and business stakeholders to understand data requirements and deliver effective solutions.

- Design and implement cloud-native data engineering solutions.

- Ensure data quality, governance, security, and compliance standards are maintained.

- Monitor, troubleshoot, and optimize data workflows for performance and reliability.

- Participate in code reviews, testing, and deployment activities following best practices.

- Collaborate with cross-functional teams in an Agile development environment.

Required Technical Skills :

Data Engineering :

- Strong experience in Data Engineering concepts and best practices.

- Experience building ETL/ELT pipelines and data integration solutions.

Programming & Querying :

- Proficient in :

1. Python

2. SQL

Streaming & Messaging :

- Hands-on experience with :

1. Apache Kafka

- Strong understanding of real-time data processing and event-driven architectures.

Cloud Technologies :

- Experience working with at least one major cloud platform :

1. AWS

2. Microsoft Azure

3. Google Cloud Platform (GCP)