Data Engineer - Spark/Scala

Summary :

Seeking a passionate Data Engineer (2-3 years' experience) to build scalable data solutions. Must have expertise in Spark (Scala), Java, AWS EMR, and AWS Glue, with end-to-end data pipeline exposure. Oracle ERP migration experience is a plus.

Key Responsibilities :

- Design, build, and optimize scalable data pipelines on AWS EMR and AWS Glue.

- Develop high-performance data processing solutions using Apache Spark (Scala) and Java.

- Manage structured and unstructured data, ensuring quality, consistency, and reliability. Collaborate with teams for data integration from source to target repositories.

- Support data migration activities (Oracle ERP migration experience a plus).

- Write efficient SQL queries and work with SQL & NoSQL databases.

- Contribute to ETL design, development, and automation for reporting and analytics.

- Ensure security, performance, and scalability of data solutions.

- 2-3 years of hands-on Data Engineering experience.

- Strong expertise in Apache Spark (Scala) and Java.

- AWS EMR and AWS Glue experience (must-have).

- Proficiency in SQL and working knowledge of NoSQL databases.

- Strong understanding of ETL pipelines and data warehousing.

- Good to have : Oracle ERP migration experience.

- Exposure to AWS cloud ecosystem and related data services.

- Programming - Apache Spark (Scala), Java

- Cloud - (AWS) AWS EMR, AWS Glue

- Data Processing- ETL pipeline design & development

- Databases - SQL (proficient), NoSQL (working knowledge)

- Data Warehousing - Data integration, pipeline optimization