Manager/Senior Manager - Lead AI Platform Engineer

AI Platform Engineer Innovation Lab

Sector : Leading Financial Markets Infrastructure Organisation

Location : Mumbai

Experience : 6+ years

Grade : Manager / Senior Manager

Role Overview :

This is a specialist AI platform engineering role distinct from generic Data Science or application development. The position demands deep expertise in MLOps/LLMOps, distributed inference, and GPU based AI infrastructure, within regulated financial environments.

Key Responsibilities :

- Architect and scale production AI systems for mission-critical financial applications.

- Lead MLOps/LLMOps pipelines and distributed model inference frameworks.

- Engineer GPU infrastructure across sovereign/private cloud and on-premise environments.

- Implement enterprise AI gateways, semantic routing, failover mechanisms, observability, and guardrails.

- Drive GPU performance tuning, production troubleshooting, and CI/CD automation.

- Collaborate with cross-functional teams to deliver secure, scalable AI innovation.

Non-Negotiable Requirements :

Education : BE/BTech/MCA in Computer Science, IT, Data Science, or related discipline

Experience : 6 - 8 years in software engineering or DevOps, including:

i. 3+ years of hands-on production MLOps/LLMOps and distributed inference.

ii. 3+ years architecting and scaling production AI systems.

iii. Proven expertise in AI platform engineering, distributed systems, GPU infrastructure.

Hands-on proficiency with :

- Languages/Frameworks : Python, FastAPI, AsyncIO, gRPC

- Inference Platforms : vLLM, NVIDIA Triton, TensorRTLLM, Ray Serve, Hugging Face TGI, llama.cpp

- Containers/Orchestration : Kubernetes, Docker, Helm, NVIDIA GPU Operator, KEDA

- Strong background in enterprise AI gateways, semantic routing, failover, observability, and guardrails.

- Expertise in GPU performance tuning, production troubleshooting, GitOps/CICD.