Job Description :
We are looking for a Senior Python Backend Engineer to join our Platform team at Profitero a global e-commerce analytics company helping 1000+ brands across 50 countries grow profitably on platforms like Amazon.
You will be at the core of our data collection infrastructure designing and operating a distributed crawling and parsing platform that processes 18TB+ of data and tracks 13 million new products every quarter. This is a high-ownership, backend-heavy role (95% server-side) with real scale and real impact.
Key Responsibilities :
- Design and develop distributed data collection systems capable of handling large-scale workloads (18TB+ data, 13M+ products per quarter)
- Build and maintain HTTP and RabbitMQ-based API services in Python using FastAPI, asyncio, and Pydantic
- Write clean, modular, and well-tested code including unit and integration tests using pytest
- Containerise applications using Docker and manage deployments on Kubernetes
- Maintain and improve CI/CD pipelines on GitLab CI (in collaboration with the Infra & DevOps team)
- Analyse, debug, and support legacy Ruby components as needed
- Own release management for your services from development through to production
- Contribute to code reviews and uphold engineering standards across the backend team
- Collaborate with cross-functional teams to integrate the crawling framework into broader data workflows
Tech stack :
- Primary : Python (asyncio, FastAPI, Pydantic, pytest), MySQL, MongoDB, RabbitMQ, Docker, Kubernetes, GitLab CI, Linux/Shell
- Good to have : Kafka, Redis, Snowflake, GCP, Airflow, Ansible, Ruby
Candidate Profile :
- 7+ years of overall software development experience, with at least 5 years in Python
- Deep working knowledge of Python's async ecosystem asyncio, coroutines, event loops, and concurrency patterns
- Strong SQL skills : ability to write complex queries and, critically, reason through and justify design choices (not just produce output)
- Hands-on experience with Docker internals container lifecycle, image layering, namespaces, and resource constraints
- Experience deploying and troubleshooting services on Kubernetes
- Solid understanding of REST and message-queue (RabbitMQ) API design, including middleware, dependency injection, and error-handling patterns
- Demonstrated culture of automated testing candidates should be able to write pytest unit tests for their own business logic, including appropriate mocking
- Familiarity with NoSQL databases, particularly MongoDB
- Good understanding of software design patterns and ability to write simple, idiomatic, modular code
- English communication skills at B2 level or above ability to articulate technical reasoning clearly, not just deliver results
Did you find something suspicious?
Posted by
Recruiter
Last Active: NA as recruiter has posted this job through third party tool.
Posted in
Backend Development
Functional Area
Backend Development
Job Code
1632944