HamburgerMenu
hirist

Senior Data Engineer - PySpark/Databricks

AAGANERA CONSULTING PRIVATE LIMITED
4 - 6 Years
Gurgaon/Gurugram

Posted on: 27/05/2026

Job Description

Job Specifications

Required Experience: 4-8 Years of experience as a Data Engineer

Work Location: Gurugram/Gurgaon - Work from office

Qualifications: Graduation/Post-Graduation from a reputed college

Role & Responsibilities

- Combine excellent abstract reasoning ability to document, architect, develop and test software with the commitment to excellence/defect free before being deployed.

- Write and implement low latency applications & software solutions that integrate different systems.

- Work closely with mentors, team members, team leads, program managers and stakeholders to investigate, fix, optimize, test and deploy high quality solutions.

- Drive the technical design, implementation and maintenance of larger tech initiatives geared toward improving and scaling of products.

- Accurately schedule & and track progress of self & team members. Creat end to end WBS & estimates for modules being implemented.

- Participate in planning & recognizing inconsistencies (e.g., scope, resources, feasibility, usability, customer value, etc.) in product requirements and alert the Project Mentor.

- Handle independently or assist the Mentor in building, testing, and documenting product releases.

- Support the team in deploying product functionality & assist the TLs in troubleshooting in the production environment.

- Rapidly incorporate new technologies as required & deliver successfully by self.

- Proactively promote Tech Culture by writing blogs, making presentations which will help you learn & grow.

- Effectively communicate one-on-one with on-shore / off-shore product teams

/ developers; gather and clarify requirements from technical folks / product managers / business teams.

- Proactively assist and serve as a role model for the team members to follow the team software development process; consistently innovate the team processes to improve team productivity and quality.

Required Skill-Set :


- Strong Analytical, Problem Solving Skills and participates in all activities with urgency, a results orientation, and a strong work ethic.

- Hands-on experience with PySpark and DataBricks is a must.

- Strong experience in Python is a must.

- Strong experience with relational (PostgreSQL, MySQL, etc.) and/or NoSQL databases (MongoDB, etc.)

- Working experience on streaming services like Kafka, AWS SQS, etc.

- Basic understanding of modern deployment solutions such as Docker, Kubernetes and similar container based deployment solutions.

- Experience with Linux/Unix Operating system & comfortable with command line.

- Experience with modern software engineering workflows and tools (e.g. Agile, JIRA, Git, CI/CD (Github actions), Amazon Web Services, ELK, APM).

- Experience with Agile development lifecycle.

info-icon

Did you find something suspicious?

Similar jobs that you might be interested in

Loading chat...