JuegoTech - QA Automation Engineer - AI Testing

Role : QA Automation with AI testing

Experience Range : 4 to 7 years

Location : Bangalore - Hybrid

Job Description :

Required Skills & Qualifications :

- 4+ years of relevant work experience in software testing, particularly in automation and test framework development.

- Proficiency in python, JavaScript, TypeScript, Postman, VS Code, Cucumber, and Node.js.

- Must have experience in Model [LLMs] evaluation testing, analysing model performance

- Strong experience in backend testing with exposure to LLMs using Swagger, postman tools.

- Must have experience in tools like Kubernetes to check the logs.

- Must have experience in model evaluation frameworks [for ex: RAGAS, DeepEval, Lang chain]

- Familiarity with various testing techniques. Knowledge of quality standards and regulations.

- Strong understanding of version control systems (GitHub) and project management tools (JIRA).

- Experience in Agile/Scrum development environments.

- A detail-oriented approach with excellent problem-solving skills.

Roles & Responsibilities :

- Develop and maintain automation test scripts for APIs and backend systems.

- Perform LLM model testing and evaluation, analyzing output quality and performance.

- Conduct API testing using Postman and Swagger.

- Work with tools like RAGAS, DeepEval, or LangChain for model validation.

- Monitor logs and debug issues using Kubernetes.

- Collaborate with developers and product teams in an Agile environment.

- Manage test cases, defects, and reports using JIRA and GitHub