Job Title: GenAI Test Engineer

Location: Chennai / Pune / Hyderabad / Bengaluru / Coimbatore / Ahmedabad / Mumbai

Experience: 69 Years

Employment Type: Full-time

Role Overview:

We are looking for an experienced GenAI Test Engineer with a strong background in Python-based automation testing and Generative AI applications. The ideal candidate will be responsible for designing and implementing robust testing frameworks for AI-powered solutions, validating Large Language Models (LLMs), RAG pipelines, and ensuring the quality, reliability, and scalability of GenAI systems. This role requires hands-on expertise in Python automation, AI model evaluation, cloud environments, CI/CD integration, and modern software testing practices.

Key Responsibilities:

- Design, develop, and maintain end-to-end test architecture for Generative AI applications.

- Build and execute automated testing frameworks for LLM-based applications, RAG systems, and AI workflows.

- Validate the accuracy, reliability, and performance of GenAI models and prompt engineering frameworks.

- Develop automated test suites using Python for APIs, backend services, databases, and AI components.

- Integrate automated testing into CI/CD pipelines to enable continuous quality assurance.

- Perform API, integration, regression, and performance testing across AI-enabled applications.

- Work closely with developers, data scientists, and product teams to identify quality risks and improve overall system reliability.

- Design scalable testing frameworks for cloud-based AI solutions across AWS, Azure, or GCP.

- Monitor test results, analyze failures, and provide actionable recommendations for quality improvements.

Required Skills & Qualifications:

Mandatory Skills:

- 69 years of experience in QA Automation Engineering.

- Minimum 2 years of hands-on experience testing Generative AI, AI/ML, or data-intensive applications.

- Strong hands-on experience with Python Automation Testing (Mandatory).

- Experience testing Large Language Models (LLMs) and Generative AI applications (Mandatory).

- Hands-on experience with Retrieval-Augmented Generation (RAG) systems.

- Experience with AI frameworks such as LangChain and AI evaluation tools.

- Strong experience integrating multiple automation tools beyond Selenium.

- Hands-on experience with SQL and Snowflake databases.

- Experience with API testing and backend automation.

- Strong understanding of Software Testing Life Cycle (STLC).

- Experience integrating automated testing into CI/CD pipelines.

- Exposure to cloud platforms such as AWS, Azure, or Google Cloud Platform (GCP).

Preferred Skills:

- Experience in prompt engineering validation and AI model evaluation.

- Knowledge of scalable test architecture for cloud-native applications.

- Familiarity with performance and security testing of AI systems.

- Strong analytical, debugging, and problem-solving skills.

- Excellent communication and collaboration skills.

Why Join Us:

- Work on cutting-edge Generative AI and LLM-based applications.

- Build scalable automation frameworks for next-generation AI platforms.

- Collaborate with cross-functional engineering and AI teams on enterprise-grade solutions.

- Opportunity to contribute to innovative cloud-native AI products and technologies