Generative AI Tester - Automation Testing

Role Overview :

We are seeking a highly skilled Gen AI Tester to design and execute test strategies that ensure the quality, reliability, and accuracy of AI-driven applications, including chatbots, agents, and generative AI tools. This role demands strong expertise in both manual and automated testing, with a focus on validating AI outputs against business requirements and expected behavior.

Key Responsibilities :

Comprehensive Test Strategy Development :

- Design, document, and execute detailed test plans and scenarios for AI chatbots, agents, and tools, ensuring rigorous validation of outputs against defined business rules and AI behavior.

- Automated Test Scripting :

- Develop, maintain, and enhance automated test scripts using Python, JavaScript, or Bash to streamline and scale testing across AI functionalities.

Defect Identification & Documentation :

- Proactively identify, log, and track issues within AI models and applications. Provide clear and actionable bug reports with reproducible steps, expected vs. actual outcomes, and severity assessment.

Cross-functional Collaboration :

- Partner with development, product, and data science teams to align on requirements, validate fixes, and provide feedback across the AI development lifecycle.

Continuous Improvement :

- Stay updated on emerging tools, techniques, and trends in AI testing and automation. Recommend and implement process improvements to enhance product quality and testing efficiency.

Performance & Scalability Testing (Optional) :

- Conduct load, stress, and scalability testing on AI models to validate system performance under diverse conditions and user loads.

Skills & Qualifications :

- Proven AI Testing Experience: Hands-on experience in testing AI-driven applications, conversational AI platforms, or generative AI tools.

- Proficient in Scripting & Automation: Strong coding skills in Python, JavaScript, or Bash for test automation.

- Analytical Acumen: Ability to interpret complex technical/business requirements and design effective test scenarios.

- Testing Expertise: Solid knowledge of manual and automated testing methodologies, including regression, integration, functional, and UAT.

- Proactive & Independent: Self-starter with strong ownership, capable of independently identifying testing needs and driving solutions.

- Communication Skills: Excellent verbal and written communication, with the ability to provide precise documentation and articulate findings to stakeholders.