- Design, implement and validate Hadoop solutions.

- Troubleshoot MapReduce/Spark Jobs and do performance tuning in production environments.

- Independently develop and sustain technical knowledge, certifications, and skills.

- Effectively handling day-to-day assignments given moderate directions and supervision.

- Analyzing the data requirements across various entities, develop and maintain data ingestion pipelines.

- Automating data validation steps and report generation.

- Automating codes/ scripts that can be repeatedly used across similar analytics and reporting requirements.

- Managing and ensuring accuracy and timeliness and automation solution in end to end data extraction and integration with analytics and management reporting system.

- Designing the jobs schedule in scheduling tools and developing the configuration files for job schedulers

- Performing L2 batch production support

JOB SKILLS AND REQUIREMENTS:

- ANALYTICAL SKILLS: To work with large amounts of data. Ability to collect, organize, analyze large amounts of data.

- COMMUNICATION SKILLS: Write and Speak Clearly with business users.

- ATTENTION TO DETAIL: Data needs to be accurate. Should be able to spot discrepancies, trends and be vigilant on data analysis.

- DOMAIN SKILLS: Experience in Financial reporting or Insurance domain - advantage

QUALIFICATIONS:

- BS/MS in Computer Science, Engineering, or similar relevant field.

- Previous working experience as a Hadoop Developer for 7-10 years.

- Proficient with Java and Scala.

- Hands-on experience on Spark framework and other distributed data processing frameworks like Hadoop Map-Reduce, Hive etc.

- Proficient in ETL tools like Talend, Datastage.

- Proficient in RDBMS databases such as Oracle, MySQL, MSSqlServer.

- Good to have working experience with one of the cloud platforms like AWS (Amazon Web Services), Microsoft Azure or Google Cloud Platform.

- Hands-on experience with Linux system administration.

- Strong communication skills to collaborate with distributed teams.

- Analytical thinker with problem solving aptitude.