Designation : Data Engineer.

Experience : 7-10 Years

Employment Type : Contract (6 months, extendable)

Shift : 2 PM - 11 PM IST

Job Overview :

We're looking for an experienced Data Engineer to join our team for a 6-month extendable contract with a US-based MNC. With 7-10 years of expertise, you'll be instrumental in designing, developing, and maintaining robust data pipelines. This role requires strong proficiency in Python, PySpark, big data technologies, and SQL to ensure efficient data processing and delivery for our client's needs.

Key Responsibilities :

- Design, develop, and maintain efficient ETL/ELT processes and data pipelines.

- Implement and optimize distributed data processing solutions using Python and PySpark.

- Work with various big data technologies to handle large volumes of data.

- Ensure data is accurately extracted, transformed, and loaded into target systems, including data warehouses and data lakes.

- Collaborate with data analysts, data scientists, and business stakeholders to understand and fulfill data requirements.

- Document data pipelines, data mappings, and technical specifications for maintainability.

- Participate in code reviews and contribute to data engineering best practices.

Required Skills :

- 7-9 years of professional experience in data engineering or related roles.

- Strong programming skills in Python and experience with PySpark for distributed data processing.

- Hands-on experience with big data technologies such as Hadoop, Spark, Hive, or similar platforms.

- Proficiency in SQL and experience working with both relational and non-relational databases.

- Familiarity with data modeling, ETL/ELT processes, and data warehousing concepts.

- Excellent problem-solving and communication skills.

Preferred Qualifications :

- Exposure to Power BI or other Business Intelligence (BI) tools.