Data Engineer/Tech Lead

Contract duration-1 year

We are seeking a dynamic and experienced Tech Lead with a strong foundation in Java and Apache Spark to join our team. In this role, you will lead the development and deployment of scalable cloud-based data solutions, leveraging your expertise in AWS and big data technologies.

Key Responsibilities :

- Lead the design, development, and deployment of scalable and reliable data processing solutions on AWS using Java and Spark.

- Architect and implement big data processing pipelines using Apache Spark on AWS EMR.

- Develop and deploy Serverless applications using AWS Lambda, integrating with other AWS services.

- Utilize Amazon EKS for container orchestration and microservices management.

- Design and implement workflow orchestration using Apache Airflow for complex data pipelines.

- Collaborate with cross-functional teams to define project requirements and ensure seamless integration of services.

- Mentor and guide team members in Java development best practices, cloud architecture, and data

engineering.

- Monitor and optimize performance and cost of deployed solutions across AWS infrastructure.

- Stay current with emerging technologies and industry trends to drive innovation and maintain a competitive edge.

Required Skills :

- Strong hands-on experience in Java development.

- Proficiency in Apache Spark for distributed data processing.

- Experience with AWS services including EMR, Lambda, EKS, and Airflow.

- Solid understanding of Serverless architecture and microservices.

- Proven leadership and mentoring capabilities.

- Excellent problem-solving and communication skills.