About the job :

Ninja Van is a late-stage logtech startup that is disrupting a massive industry with innovation and cutting edge technology.

Launched 2014 in Singapore, we have grown rapidly to become one of Southeast Asia's largest and fastest-growing express logistics companies.

Since our inception, weve delivered to 100 million different customers across the region with added predictability, flexibility and convenience.

Join us in our mission to connect shippers and shoppers across Southeast Asia to a world of new possibilities.

More About Us :

- We process 250 million API requests and 3TB of data every day.

- We deliver more than 2 million parcels every day.

- 100% network coverage with 2600+ hubs and stations in 6 SEA markets (Singapore, Malaysia, Indonesia, Thailand, Vietnam and Philippines), reaching 500 million consumers.

- 2 Million active shippers in all e-commerce segments, from the largest marketplaces to the individual social commerce sellers.

- Raised more than US$500 million over five rounds.

We are looking for world-class talent to join our crack team of engineers, product managers and designers.

We want people who are passionate about creating software that makes a difference to the world. We like people who are brimming with ideas and who take initiative rather than wait to be told what to do.

We prize team-first mentality, personal responsibility and tenacity to solve hard problems and meet deadlines.

As part of a small and lean team, you will have a very direct impact on the success of the company.

Roles & Responsibilities :

- Design, develop, and maintain Ninja Van's infrastructure for data streaming, processing, and storage.

- Build tools to ensure effective maintenance and monitoring of the data infrastructure.

- Contribute to key architectural decisions for data pipelines and lead the implementation of major initiatives.

- Collaborate with stakeholders to deliver scalable and high-performance solutions for data requirements, including extraction, transformation, and loading (ETL) from diverse data sources.

- Enhance the team's data capabilities by sharing knowledge, enforcing best practices, and promoting data-driven decision-making.

- Develop and enforce Ninja Van's data retention policies and backup strategies, ensuring data is stored redundantly and securely.

Requirements :

- Solid computer science fundamentals, excellent problem-solving skills, and a strong understanding of distributed computing principles.

- At least 8+ years of experience in a similar role, with a proven track record of building scalable and high-performance data infrastructure using Python, PySpark, Spark, and Airflow.

- Expert-level SQL knowledge and extensive experience working with both relational and NoSQL databases.

- Advanced knowledge of Apache Kafka, along with demonstrated proficiency in Hadoop v2, HDFS, and MapReduce.

- Hands-on experience with stream-processing systems (e.g., Storm, Spark Streaming), big data querying tools (e.g., Pig, Hive, Spark), and data serialization frameworks (e.g., Protobuf, Thrift, Avro).

- [Good to have] Familiarity with infrastructure-as-code technologies like Terraform, Terragrunt, Ansible, or Helm.

- (Good to have) Experience with Change Data Capture (CDC) technologies such as Maxwell or Debezium.

- Bachelors or Masters degree in Computer Science or a related field from a top university.

Tech Stack :

- Backend : Play (Java 8+), Golang, Node.js , Python, FastAPI

- Frontend : AngularJS, ReactJS

- Mobile : Android, Flutter, React Native

- Cache : Hazelcast, Redis

- Data storage : MySQL, TiDB, Elasticsearch, Delta Lake

- Infrastructure monitoring : Prometheus, Grafana

- Orchestrator : Kubernetes

- Containerization : Docker, Containerd

- Cloud Provider : GCP, AWS

- Data pipelines : Apache Kafka, Spark Streaming, Maxwell/Debezium, PySpark, TiCDC

- Workflow manager : Apache Airflow

- Query engines : Apache Spark, Trino