Role Description :

We are seeking an experienced Gen AI Testing Lead to join our team in Chennai. This is a full-time, on-site leadership position responsible for defining, implementing, and executing comprehensive testing strategies for Generative AI applications and Large Language Model (LLM)-based solutions. You will oversee test planning, automation, and execution, ensuring that AI-driven systems meet performance, security, compliance, and functional requirements.

You will work closely with AI/ML engineers, data scientists, product managers, and quality teams to validate AI models, optimize testing frameworks, and maintain robust quality standards across the product lifecycle.

Key Responsibilities :

- Lead the end-to-end testing lifecycle for Gen AI and LLM-based applications, from test strategy definition to execution and reporting.

- Develop, maintain, and optimize manual and automated test cases tailored for AI/ML workloads, model pipelines, and prompt engineering scenarios.

- Conduct functional, performance, security, and compliance testing for LLM deployments.

- Validate AI/ML architecture components, ensuring model outputs meet accuracy, bias, interpretability, and safety benchmarks.

- Implement Gen AI security testing methodologies to detect prompt injection, data leakage, adversarial attacks, and other vulnerabilities.

- Ensure regulatory and ethical compliance for AI systems, particularly in sensitive domains such as Life Sciences.

- Collaborate with AI researchers to assess LLM fine-tuning, model versioning, and inference behavior against expected outcomes.

- Monitor model drift and data quality, recommending improvements to maintain high-performance levels.

- Document testing procedures, results, and lessons learned to support continuous improvement.

Qualifications :

- 6+ years of experience in software testing, with a focus on AI/ML or advanced technology domains.

- Strong analytical skills and problem-solving abilities for complex AI workflows.

- Proven expertise in test case design, execution, and automation frameworks.

- Proficiency in Generative AI, LLM architectures, and prompt engineering methodologies.

- Experience with Gen AI security testing and compliance frameworks for AI governance.

- Hands-on experience with AI/ML architecture validation and model testing.

- Familiarity with Life Sciences domain compliance requirements is a strong plus.

- Excellent verbal and written communication skills for cross-functional collaboration.

- Bachelors degree in Computer Science, Information Technology, or related field; advanced degree preferred.