HamburgerMenu
hirist

Senior Backend & MLOps Engineer - Python/Kubeflow

CRESCENDO GLOBAL LEADERSHIP HIRING INDIA PRIVATE L
5 - 8 Years
Multiple Locations

Posted on: 16/11/2026

Job Description

Summary :

We are seeking an experienced Senior Backend & MLOps Engineer to bridge AI/ML engineering, scalable backend architecture, and production machine learning infrastructure by building high-performance Python microservices and architecting end-to-end ML pipelines using Kubeflow and cloud-native infrastructure.

Responsibilities :

- Design, build, and maintain high-throughput, low-latency Python microservices (FastAPI, Flask, Django) and production-grade APIs for AI model inference and data processing pipelines.

- Architect, deploy, and manage end-to-end production ML pipelines using Kubeflow Pipelines (KFP) and Kubeflow Notebooks, alongside automated CI/CD for machine learning (CT/CD) including retrain triggers, evaluation, and deployment.

- Standardize model serving (KServe, Triton Inference Server, BentoML) and manage model versioning, feature stores, and experiment tracking using MLflow, Feast, or Weights & Biases.

- Optimize database performance across relational, NoSQL, and vector stores (PostgreSQL, Redis, MongoDB, Pinecone, Weaviate, Milvus) and implement asynchronous task queues and event-driven workflows (Celery, RabbitMQ, Kafka).

- Manage cloud-native AI workload clusters on Kubernetes (K8s), Helm, and Docker across AWS, GCP, or Azure (EKS, GKE, AKS), ensuring GPU/CPU cost-efficiency, security, and observability via Prometheus, Grafana, and the ELK Stack.

Requirements :

- 5+ years of hands-on experience in software engineering, backend development, and MLOps with advanced proficiency in Python (asyncio, memory management, multiprocessing, and object-oriented design).

- Deep hands-on production experience with Kubeflow (Pipelines, KServe, Katib) and model serving/experimentation tooling.

- Strong expertise in Docker and Kubernetes (CRDs, ingress controllers, resource limits, GPU node pools) across major cloud providers (AWS, GCP, or Azure).

- Practical knowledge of ML frameworks (PyTorch, TensorFlow, Scikit-learn) and LLM deployment frameworks (vLLM, Ollama, Hugging Face ecosystem).

- Proven experience with SQL/NoSQL databases, Vector DBs, event-driven messaging (Kafka, RabbitMQ, Redis), and GitOps/CI-CD pipelines (ArgoCD, GitHub Actions, GitLab CI/CD) tailored for ML workflows.

What is in it for you :

- Direct ownership over bridging scalable backend systems with cutting-edge production AI/ML and LLM deployment infrastructure.

- Close collaboration with Data Scientists and DevOps teams to solve complex GPU/CPU scaling, low-latency inference, and model drift challenges.

- Opportunity to work with a modern, cloud-native MLOps stack including Kubeflow, KServe, vLLM, Kubernetes, and vector databases.

- High-impact engineering role driving automation, reliability, and performance in a fast-growing AI/ML platform environment.

info-icon

Did you find something suspicious?

Similar jobs that you might be interested in

Loading chat...