HamburgerMenu
hirist

Spydra - AI Inference Reliability Engineer

Spydra
5 - 9 Years
Hyderabad

Posted on: 19/11/2026

Job Description

About the role:

You will operate resilient, scalable and observable production AI inference services.

Key responsibilities:

- Deploy inference services using Kubernetes, containers and release automation.

- Implement autoscaling, GPU-aware scheduling, load balancing and traffic management.

- Design high availability, disaster recovery, rollback and automated recovery.

- Monitor GPU utilisation, memory, TTFT, throughput, errors and service health.

- Manage incidents, root-cause analysis and performance degradation.

- Define service-level objectives, error budgets, capacity plans and operational runbooks.

Tech Stack:

Kubernetes, Docker, Helm, Argo CD, Prometheus, Grafana, NVIDIA GPU Operator, Python, Linux, CI/CD, observability.

Expected deliverables:

Reliable inference deployments, monitoring, runbooks and recovery procedures.

info-icon

Did you find something suspicious?

Similar jobs that you might be interested in

Posted by

Sumandeep Tuteja

HR Associate at Spydra

Last Active: NA as recruiter has posted this job through third party tool.

Job Views:  
14
Applications:  7
Recruiter Actions:  0

Posted in

DevOps / SRE

Functional Area

Site Reliability Engineering

Job Code

1684636

Loading chat...