Data Engineer - Python/PySpark

Primary Skills :

- PySpark queries MUST.

Experience : 15+ Years.

Location : Hyderabad (5 days a week Work from Office).

Responsibilities :

- Collaborate with product and technology teams to design and validate the capabilities of the data platform.

- Identify, design, and implement process improvements : automating manual processes, optimizing for usability, re-designing for greater scalability.

- Provide technical support and usage guidance to the users of our platforms services.

- Drive the creation and refinement of metrics, monitoring, and alerting mechanisms to give us the visibility we need into our production services.

Qualifications :

- Experience building and optimizing data pipelines in a distributed environment.

- Experience supporting and working with cross-functional teams.

- Proficiency working in Linux environment.

- 4+ years of advanced working knowledge of SQL, Python, and PySpark.

- Knowledge on Palantir.

- Experience using tools such as : Git/Bitbucket, Jenkins/Code Build, Code Pipeline.

- Experience with platform monitoring and alerts tools.