DevOps Engineer - LLM Model Deployment

Talpro

Talpro is leading the way in transforming the talent acquisition landscape.

We deliver innovative, sustainable, and cost-effective recruitment solutions tailored to todays business needs.

Our mission is to offer comprehensive hiring strategies that address immediate recruitment demands while laying the groundwork for long-term success.

Job Description

Experience: 812 Years

Location: Trichy, Chennai, Bengaluru, Noida, Gurgaon, Mumbai, Ahmedabad, Pune

Notice Period: Immediate Joiners Preferred

Role Type: Full-Time, Permanent with Client

Primary Skills to Focus :

- CI/CD (Jenkins, GitLab CI, CircleCI)

- Infrastructure as Code (Terraform, Ansible, CloudFormation)

- Cloud Platforms: AWS, Azure, GCP

- Docker & Kubernetes

- Monitoring & Logging: Prometheus, Grafana, ELK Stack, Datadog

- Python / Bash / PowerShell

- Git

- DevSecOps

- LLM Deployment & ModelOps

Role Overview:

We are hiring a seasoned LLM DevOps Engineer responsible for building, scaling, and managing CI/CD pipelines, infrastructure automation, and production-grade LLM model deployments.

The role involves close collaboration with development, ML, operations, and security teams to ensure seamless software delivery and scalable cloud infrastructure.

Key Responsibilities:

- Design, implement, and maintain CI/CD pipelines for automated and secure deployments.

- Deploy, monitor, and optimize Large Language Models (LLMs) in production.

- Automate infrastructure provisioning using Terraform, Ansible, or CloudFormation.

- Manage and scale cloud infrastructure across AWS, Azure, and GCP.

- Containerize applications using Docker and manage orchestration via Kubernetes.

- Integrate security tools and controls into CI/CD pipelines (DevSecOps).

- Develop monitoring, logging, and alerting solutions for infra & model performance.

- Implement testing automation across the software lifecycle.

- Maintain version control, ensure code integrity, and promote best DevOps practices.

- Conduct code reviews, internal training sessions, and participate in tool evaluations