We are looking for a highly analytical and detail-oriented Quality Engineer with strong expertise in both traditional software testing and emerging AI-driven systems. This role focuses on ensuring the quality, reliability, and performance of digital platforms, with a special emphasis on validating Large Language Model (LLM) outputs and intelligent applications.

You will play a critical role in driving quality across the entire software development lifecycle, from requirement analysis to production release. The ideal candidate combines strong QA fundamentals with curiosity and hands-on experience in testing AI/ML systems, including prompt validation and edge-case exploration.

Key Responsibilities :

1. Test Strategy & Planning :

Design and implement comprehensive test strategies, test plans, and test cases covering :

1. Functional testing

2. System and integration testing

3. UI/UX validation

- Define acceptance criteria and ensure alignment with business requirements and user expectations.

- Collaborate with stakeholders to ensure early test involvement in the SDLC.

2. AI/LLM Testing & Validation :

Evaluate LLM-generated outputs for :

- Accuracy and factual correctness

- Contextual relevance and coherence

- Consistency across prompts

- Safety, bias, and ethical compliance

Perform :

- Prompt engineering validation

- Adversarial testing (jailbreaks, hallucinations, edge prompts)

- Edge-case and boundary testing for AI systems

- Develop test datasets and benchmark scenarios for AI model evaluation.

3. Automation & Tools :

- Develop and maintain automated test frameworks to improve test coverage and efficiency.

Work with tools such as :

1. Selenium, Appium

2. Cucumber (BDD)

3. Robot Framework, Watir

- Integrate automation into CI/CD pipelines for continuous testing.

- Identify opportunities to automate repetitive and regression test scenarios.

4. Defect Management & Collaboration :

- Identify, document, and track defects using standard tools (e.g., Jira, Azure DevOps).

- Prioritize issues based on severity and business impact.

- Collaborate closely with developers, product managers, and designers to ensure timely resolution.

- Participate in sprint planning, daily stand-ups, and retrospectives.

5. Performance & Reliability Testing :

Validate system performance under various conditions :

1. Load and stress testing

2. Scalability testing

- Ensure application stability, responsiveness, and reliability across platforms (web, mobile, APIs).

6. API & Integration Testing :

- Test RESTful and/or GraphQL APIs using tools like Postman or RestAssured.

- Validate data integrity and system interactions across services.

7. Quality Process Improvement :

- Drive continuous improvement of QA methodologies, standards, and best practices.

- Establish quality metrics and KPIs to track product health.

- Advocate for shift-left testing and quality-first mindset across teams.

Required Skills & Experience :

Core Requirements :

- 5+ years of experience in Quality Engineering / Software Testing

- Hands-on experience testing web, mobile, and API-based applications

- Strong understanding of :

- Behavior-Driven Development (BDD)

- Test-Driven Development (TDD)

- Experience working in Agile/Scrum environments

AI/ML Testing (Preferred) :

- Exposure to AI/ML-based systems or data-driven applications

- Understanding of LLM behavior, limitations (hallucination, bias), and evaluation techniques

- Experience in prompt testing and validation is a strong plus

Automation & Tools :

Strong experience with automation frameworks :

1. Selenium, Appium, Cucumber

2. Robot Framework, Watir

- Familiarity with CI/CD tools (Jenkins, GitHub Actions, GitLab CI, etc.)

- Experience with legacy tools like QTP (UFT) or Silk Test is a plus

Technical Skills :

- Knowledge of programming/scripting languages (Java, Python, or JavaScript preferred)

- Experience with API testing tools (Postman, RestAssured)

- Understanding of databases and basic SQL queries