QA Automation Engineer

Experience : 5+ Years

Location : Bangalore / Hyderabad / Pune / Noida

Job Summary :

We are looking for an experienced QA Automation Engineer with 5+ years of expertise in test automation using Playwright and TypeScript, along with hands-on exposure to Generative AI and Agentic AI. The candidate will be responsible for designing scalable automation frameworks, implementing automated test strategies, and leveraging AI technologies to enhance software quality and testing efficiency.

Key Responsibilities :

- Design, develop, and maintain scalable UI and API automation frameworks using Playwright and TypeScript.

- Develop automated test scripts for functional, regression, integration, and end-to-end testing.

- Create reusable test components, utilities, and automation libraries.

- Integrate automated tests into CI/CD pipelines and support continuous testing.

- Identify and analyze defects, perform root-cause analysis, and collaborate with development teams for resolution.

- Develop automation strategies for Gen AI and Agentic AI-based applications.

- Validate AI/LLM-powered applications, including response accuracy, consistency, reliability, and functional behavior.

- Design test scenarios for AI agents, agent workflows, tool calling, prompts, and multi-step interactions.

- Implement AI-assisted testing techniques to improve test coverage and automation efficiency.

- Work with QA, development, product, and AI/ML teams to define quality standards and testing approaches.

- Maintain automation dashboards, test reports, and documentation.

Required Skills :

- 5+ years of experience in QA/Test Automation.

- Strong hands-on experience with Playwright.

- Strong programming experience in TypeScript/JavaScript.

- Experience in UI, API, functional, regression, and end-to-end automation testing.

- Strong understanding of automation framework design and test architecture.

- Experience with Git and CI/CD tools such as Jenkins, GitHub Actions, GitLab CI, or Azure DevOps.

- Hands-on exposure to Generative AI / LLM-based applications.

- Understanding of Agentic AI concepts, AI agents, workflows, prompt validation, and tool/function calling.

- Experience testing applications integrating LLMs, APIs, RAG, or AI agents is preferred.

- Strong knowledge of software testing methodologies, SDLC, and STLC.

- Good analytical, debugging, and problem-solving skills.

Good to Have :

- Experience with API automation using Playwright, REST Assured, Postman, or similar tools.

- Knowledge of Python or another programming language.

- Exposure to LLM evaluation, RAG testing, prompt testing, and AI response validation.

- Experience with AI frameworks/tools such as LangChain, LangGraph, or similar agent frameworks.

- Knowledge of cloud platforms such as AWS, Azure, or GCP.

- Experience with Docker and Kubernetes.

- Familiarity with performance and security testing concepts.

Education :

- Bachelors degree in Computer Science, Information Technology, Engineering, or a related field.