HamburgerMenu
hirist

Lead PySpark Developer - Python/Numpy

Pr Glolinks
9 - 15 Years
Multiple Locations

Posted on: 29/08/2026

Job Description

About the Role:

We are hiring for a digital strategy and software engineering firm providing bespoke technology solutions that drive business change for customers the world over. They have global clients innovate in the areas of automotive, financial services, travel and hospitality, healthcare, life sciences, media, and telecommunications. It is a direct and permanent role.

Skills required:

- 10+ years of experience in data intensive Pyspark development

- Must have experience in leading a Development Team

- Proven experience as a Core Python developer

- Good understanding of Gen AI

- Experience developing Classes, OOPS, exception handling, parallel processing

- Strong knowledge of DB connectivity, data loading, transformation, calculation

- Extensive experience in Pandas/Numpy dataframes, slicing, data wrangling, aggregations

- Lambda Functions, Decorators

- Vector operations on Pandas dataframes/series

- Application of applymap, apply, map functions

- Concurrency and error handling data pipeline batch of size [1-10 gb]

- Ability to understand business requirements and translate them into technical requirements

- Ability to design architecture of data pipeline for concurrent data processing

- Familiar with creating/designing RESTful services and APIs

- Familiar with application unit tests

- Working with Git source control, service-orientated architecture, including the ability to consider integrations with other applications and services

- Debugging application

Nice To Have:

- Knowledge of web backend technology - Django, Python, PostgreSQL.

- Apache Airflow

- Atlassian Jira

- Understanding of Financial Markets Asset Classes (FX, FI, Equities, Rates, Commodities & Credit), various trade types (OTC, exchange traded, Spot, Forward, Swap, Options) and related systems is a plus

- Surveillance domain knowledge, regulations (MAR, MIFID, CAT, Dodd Frank) and related Systems knowledge is certainly a plus

Responsibilities:

- Develop software applications based on business requirements

- Maintain software applications and make enhancements according to project specifications

- Participate in requirement analysis, design, development, testing, and implementation activities

- Propose new techniques and technologies for software development.

- Perform unit testing and user acceptance testing to evaluate application functionality

- Ensure to complete the assigned development tasks within the deadlines

- Work in compliance with coding standards and best practices

- Provide assistance to Junior Developers when needed.

- Perform code reviews and recommend improvements.

- Review business requirements and recommend changes to develop reliable applications.

- Develop coding documentation and other technical specifications for assigned projects.

- Act as primary contact for development queries and concerns.

- Analyze and resolve development issues accurately.

info-icon

Did you find something suspicious?

Similar jobs that you might be interested in

Loading chat...