HamburgerMenu
hirist

Neoware - AI Test Engineer - Python/Automation

Neoware Technology Solutions
3 - 5 Years
Multiple Locations

Posted on: 16/11/2026

Job Description

Job Description - AI Testing Engineer

Experience: 3 - 5 Years

Location: Chennai / Bangalore

Job Summary:

We are looking for an AI Testing Engineer with experience in software testing, Python automation, and validation of AI-powered applications.

Key Responsibilities:

- Perform functional, API, integration, and regression testing of AI applications.

- Validate AI/ML and Generative AI outputs for accuracy and reliability.

- Test LLM responses, prompts, and hallucinations.

- Develop automated test scripts using Python and PyTest.

- Identify defects and collaborate with development teams to resolve issues.

Required Skills:

- 3 - 5 years of experience in software testing.

- Strong Python and test automation skills.

- Experience in API testing using Postman.

- Knowledge of AI/ML, Generative AI, and LLM testing.

- Hands-on experience in evaluation testing (Eval Testing) of AI/LLM applications, including response quality, accuracy, relevance, and consistency.

- Understanding of SQL, Git, and defect-tracking tools such as Jira.

Preferred:

- Hands-on experience with RAG applications and AI evaluation frameworks such as DeepEval or Ragas.

info-icon

Did you find something suspicious?

Similar jobs that you might be interested in

Loading chat...