About the Role:

We are looking for an experienced Lead QA - Python & AI to lead quality engineering initiatives, develop scalable automation frameworks, and ensure the reliability and performance of AI-powered applications.

Key Responsibilities:

- Lead end-to-end quality assurance activities, including test planning, test design, automation, execution, and reporting.

- Design, develop, and maintain scalable test automation frameworks using Python.

- Lead functional, regression, integration, API, and end-to-end testing.

- Develop testing strategies for AI/ML applications, including model validation, accuracy, reliability, and performance testing.

- Validate AI-generated outputs for correctness, consistency, bias, and unexpected behaviour.

- Test AI/LLM-based applications, including prompt validation, response quality, and hallucination detection.

- Integrate automated tests into CI/CD pipelines to support continuous testing.

- Collaborate with developers, data scientists, ML engineers, and product teams to define quality standards.

- Identify, investigate, and troubleshoot defects, perform root-cause analysis, and drive resolution.

- Establish quality metrics, automation coverage, and reporting mechanisms.

- Mentor QA engineers, review automation code, and promote best practices.

Required Skills:

- 10 - 14 years of experience in Quality Assurance or Test Automation.

- Strong hands-on expertise in Python programming and frameworks like Pytest, Selenium, or Playwright.

- Experience testing AI/ML-based applications and validating model outputs.

- Knowledge of REST APIs, SQL, and test data management.

- Experience with Git, CI/CD pipelines (Jenkins, GitHub Actions).

- Experience leading QA teams and defining test strategies.

Good to Have:

- Experience with LLM testing and Generative AI applications.

- Exposure to AI evaluation frameworks and cloud platforms (AWS, Azure, GCP).

- Knowledge of performance testing tools and observability practices.