Senior Artificial Intelligence Engineer - Python/LLM

CAW
Hyderabad
5 - 8 Years

Posted on: 03/06/2025

Job Description

We're building an AI orchestration platform that connects specialized AI agents through a smart conversational interface.

These agents will automate tasks like content writing, onboarding, social media management, and proposal creation-eventually scaling to over 30 agents coordinated by a master chatbot.

What You'll Work On :

- Build modular AI agents for different business tasks.

- Develop a central chatbot that can route user queries to the right agent.

- Create a memory system using vector databases to manage context in conversations.

- Connect to tools like Slack, live chat, and ticketing systems for human handover.

- Make sure the platform can handle 1000+ users at once with response times under 2 seconds.

Our Tech Stack :

- Languages : Python (async), TypeScript, Go.

- AI Tools : LangChain, LangGraph, LangFlow, LlamaIndex, vLLM.

- LLMs : OpenAI, Anthropic, LLaMA 2, Mistral.

- Databases : PostgreSQL, Redis, PgVector, Weaviate, Qdrant.

- Infra : FastAPI, Kafka, Docker, Kubernetes.

What We're Looking For :

Must-Have Skills :

- 5+ years of experience in Python, including async programming.

- Experience designing APIs and building microservices.

- Hands-on with LangChain or similar AI frameworks.

- Built systems with 1000+ active users.

- Strong skills in debugging and performance tuning.

Bonus Skills :

- Worked with vector databases or semantic search.

- Integrated and fine-tuned LLMs (OpenAI, LLaMA, etc.

- Familiarity with LangGraph or agent orchestration tools.

- Experience with Kubernetes or distributed systems.

Challenges You'll Solve :

- Scale the platform from 4 to 30+ AI agents.

- Route user inputs intelligently between agents.

- Maintain conversation context and handle state.

- Cache smartly for performance.

- Deliver fast, reliable responses under high load.

info-icon

Did you find something suspicious?