We're building an AI orchestration platform that connects specialized AI agents through a smart conversational interface.
These agents will automate tasks like content writing, onboarding, social media management, and proposal creation-eventually scaling to over 30 agents coordinated by a master chatbot.
What You'll Work On :
- Build modular AI agents for different business tasks.
- Develop a central chatbot that can route user queries to the right agent.
- Create a memory system using vector databases to manage context in conversations.
- Connect to tools like Slack, live chat, and ticketing systems for human handover.
- Make sure the platform can handle 1000+ users at once with response times under 2 seconds.
Our Tech Stack :
- Languages : Python (async), TypeScript, Go.
- AI Tools : LangChain, LangGraph, LangFlow, LlamaIndex, vLLM.
- LLMs : OpenAI, Anthropic, LLaMA 2, Mistral.
- Databases : PostgreSQL, Redis, PgVector, Weaviate, Qdrant.
- Infra : FastAPI, Kafka, Docker, Kubernetes.
What We're Looking For :
Must-Have Skills :
- 5+ years of experience in Python, including async programming.
- Experience designing APIs and building microservices.
- Hands-on with LangChain or similar AI frameworks.
- Built systems with 1000+ active users.
- Strong skills in debugging and performance tuning.
Bonus Skills :
- Worked with vector databases or semantic search.
- Integrated and fine-tuned LLMs (OpenAI, LLaMA, etc.
- Familiarity with LangGraph or agent orchestration tools.
- Experience with Kubernetes or distributed systems.
Challenges You'll Solve :
- Scale the platform from 4 to 30+ AI agents.
- Route user inputs intelligently between agents.
- Maintain conversation context and handle state.
- Cache smartly for performance.
- Deliver fast, reliable responses under high load.
Did you find something suspicious?
Posted By
Ranjana Singh
Last Login: NA as recruiter has posted this job through third party tool.
Posted in
AI/ML
Functional Area
ML / DL Engineering
Job Code
1489619
Interview Questions for you
View All