- Design, develop, and maintain test automation frameworks from scratch using NodeJS and/or JavaScript/TypeScript (i.e. Selenium, Playwright, Cypress etc.).

- Define and implement the AI testing strategy for enterprise solutions.

- Develop tests for Agentic AI and RAG applications, ensuring that the highest possible accuracy levels are met.

- Collaborate with DevOps teams to ensure seamless integration of test automation within the CI/CD process for continuous testing and deployment.

- Collaborate with development teams on version control workflows (branching, merging, pull requests) to ensure test automation is in sync with the development lifecycle.

- Use test management tools like Zephyr or Xray to organize, track, and report on test cases, plans, and execution results.

- Work with product managers, developers, and QA engineers to understand product requirements and translate them into automated tests.

- Implement strategies to optimize the speed and efficiency of test execution.

What you'll bring :

- 5+ years of experience with coding + test automation tools (Selenium, Cypress, Playwright etc.)

- Strong understanding of GenAI evaluations, metrics, hallucinations

- Strong expertise with Agentic AI and RAG testing metrics and frameworks

- CI/CD knowledge GitLab (preferrred) / GitHub Actions / AWS Pipeline / Azure Devops / Jenkins

- Expertise with test management tools such as Zephyr / Xray