Lead Data Engineer - Java/Spark

We are seeking an experienced Lead Data Engineer to design, build, and optimize large-scale data solutions. This role involves working with modern cloud and big data technologies to enable data-driven decision-making, while leading initiatives that ensure scalability, reliability, and efficiency.

Key Responsibilities :

- Lead the design and deployment of scalable data processing solutions on AWS using Java and Spark.

- Architect and implement big data pipelines with Apache Spark on AWS EMR.

- Develop and deploy Serverless applications using AWS Lambda and integrate with other AWS services.

- Manage containerized applications with Amazon EKS for microservices orchestration.

- Design and implement workflow orchestration with Apache Airflow for complex data pipelines.

- Collaborate with cross-functional teams to ensure data solutions meet business needs.

- Mentor junior engineers and drive best practices in data engineering.

Key Skills & Qualifications :

- 8-12 years of experience in data engineering with leadership responsibilities.

- Strong expertise in AWS (EMR, Lambda, EKS) and big data technologies (Java, Spark).

- Hands-on experience with Apache Airflow for orchestration.

- Strong problem-solving and architectural design skills.

- Excellent communication and leadership abilities.

- Ability to thrive in hybrid working environments.