We are looking for a Senior Software Engineer AI Inference to design and develop scalable AI inference platforms for large-scale production environments. The ideal candidate should have strong expertise in distributed systems, cloud-native technologies, and AI inference frameworks.

Key Responsibilities

Design and build scalable, high-performance AI inference services.

Develop and optimize distributed systems for reliability, scalability, and performance.

Collaborate with cross-functional teams to deliver production-ready AI infrastructure.

Improve system performance through observability, automation, and infrastructure optimization.

Mentor team members and contribute to architecture and technical design.

Required Skills

5+ years of experience in backend software engineering or distributed systems.

Strong programming skills in Go/Golang or Python.

Experience with Kubernetes, microservices, and cloud-native architectures.

Knowledge of AI inference frameworks such as vLLM, Ray Serve, SGLang, or similar.

Understanding of GPU optimization, LLM serving, distributed systems, and Infrastructure as Code (IaC).