Role : Big Data Engineer

Exp : 7-13 Yrs

Job location : Bangalore (Hybrid)

Role Overview :

Our Client is looking for a high-caliber Data Engineer who thrives in handling large-scale, complex data ecosystems. The ideal candidate should have deep expertise in distributed data processing, real-time streaming, and ETL pipelines, with hands-on experience in Apache Kafka / Confluent Kafka and strong programming skills in Java or Scala.

This role is best suited for someone who has worked on high-volume, high-velocity data systems across domains like Contact Center, Workforce Management, Logistics, E-commerce, or Energy/IoT platforms.

Key Responsibilities :

- Design, build, and optimize scalable ETL/data pipelines for processing massive datasets

- Develop and maintain real-time streaming solutions using Apache Kafka / Confluent Kafka

- Work on distributed data systems handling high throughput and low latency

- Process and transform large, complex datasets from multiple sources

- Ensure data reliability, quality, and performance tuning across pipelines

- Collaborate with cross-functional teams to deliver data-driven solutions

- Troubleshoot and resolve data bottlenecks and system inefficiencies

Core Requirements : 7 to 13 years of experience in Data Engineering / Big Data ecosystem

Strong hands-on experience with :

- ETL frameworks & pipeline design

- Apache Kafka / Confluent Kafka (must-have)

- Java or Scala (strong coding expertise)

- Experience working with large-scale, distributed data systems

Solid understanding of :

- Data modeling

- Streaming vs batch processing

- performance optimization

Preferred Background :

Candidates with experience in any of the following domains will be highly preferred :

- Contact Center / Workforce Management platforms

- Logistics / Supply Chain systems

- E-commerce platforms

- Energy / IoT ecosystems

What They're Looking For :

- Someone who has handled complexity at scale (not just small pipelines)

- Strong problem solver with a systems thinking mindset

- Ability to work in high-impact, data-intensive environments

- Experience dealing with high data volume, velocity, and variety

Nice to Have :

- Experience with cloud platforms (AWS/GCP/Azure)

- Exposure to Spark, Flink, or similar frameworks

- Knowledge of containerization (Docker/Kubernetes)