Posted on: 04/12/2025
Job Description : Senior Platform Engineer
Role Type : Full-time, Senior Level (5+ years experience)
Overview :
Join the engineering team for GuardrailV2, an AI-powered content governance platform running on Azure.
Youll maintain and improve a microservices-based SaaS platform with 15+ backend services, React frontend, and Kubernetes orchestration.
Core Responsibilities :
- Maintain Python microservices (FastAPI, async patterns)
- Manage Azure infrastructure (AKS, PostgreSQL, CosmosDB, Redis)
- Deploy and orchestrate services via Kubernetes + Helm
- Integrate and maintain LLM services (OpenAI, LiteLLM, LangChain)
- Debug production issues and improve system reliability
- Write and maintain infrastructure as code (Terraform/Terragrunt)
- Participate in on-call rotation
Required Skills :
- Python (FastAPI, async/await, pytest) - PRIMARY
- Azure (AKS, managed databases, Key Vault)
- Kubernetes + Helm (deployment, troubleshooting)
- Terraform/Terragrunt (infrastructure as code)
- Databases (PostgreSQL, MongoDB, Redis)
- Docker and containerization
- Git workflows and PR reviews
Highly Desired :
- LLM/AI integration experience (OpenAI, Anthropic, LangChain)
- Azure DevOps Pipelines (CI/CD)
- Monitoring tools (Prometheus, Grafana)
- API Gateway experience (KrakenD or similar)
Technology Stack :
- Backend : Python (FastAPI)
- Frontend : React + Vite + TailwindCSS
- Infrastructure : Azure (AKS, PostgreSQL, CosmosDB), Kubernetes, Helm, Terraform
- AI/ML : OpenAI, LiteLLM, LangChain, spaCy, LlamaIndex
What Youll Work On :
- Fixing broken multi-tenancy and customer onboarding systems
- Improving deployment reliability and automation
- Maintaining 15+ Python microservices
- LLM provider integration and optimization
- Infrastructure updates and scaling
- Building proper CI/CD pipelines
Did you find something suspicious?
Posted By
Posted in
DevOps / SRE
Functional Area
ML / DL Engineering
Job Code
1584235
Interview Questions for you
View All