Posted on: 16/11/2026
Job Description - AI Testing Engineer
Experience: 3 - 5 Years
Location: Chennai / Bangalore
Job Summary:
We are looking for an AI Testing Engineer with experience in software testing, Python automation, and validation of AI-powered applications.
Key Responsibilities:
- Perform functional, API, integration, and regression testing of AI applications.
- Validate AI/ML and Generative AI outputs for accuracy and reliability.
- Test LLM responses, prompts, and hallucinations.
- Develop automated test scripts using Python and PyTest.
- Identify defects and collaborate with development teams to resolve issues.
Required Skills:
- 3 - 5 years of experience in software testing.
- Strong Python and test automation skills.
- Experience in API testing using Postman.
- Knowledge of AI/ML, Generative AI, and LLM testing.
- Hands-on experience in evaluation testing (Eval Testing) of AI/LLM applications, including response quality, accuracy, relevance, and consistency.
- Understanding of SQL, Git, and defect-tracking tools such as Jira.
Preferred:
- Hands-on experience with RAG applications and AI evaluation frameworks such as DeepEval or Ragas.
Did you find something suspicious?
Posted by
Posted in
Quality Assurance
Functional Area
QA & Testing
Job Code
1683724