Software Test Engineer - Artificial Intelligence

Responsibilities :

- Design, develop, and execute test plans and test cases for AI modules.

- Collaborate with the development team to understand AI algorithms and their implementation.

- Perform functional, regression, and performance testing on AI models and systems.

- Identify, document, and track defects and inconsistencies in AI modules.

- Develop automated test scripts to improve testing efficiency.

- Analyze test results and provide detailed reports to stakeholders.

- Ensure compliance with industry standards and best practices in AI testing.

- Continuously improve testing processes and methodologies.

Requirements :

- Bachelor's degree in computer science, Engineering, or equivalent.

- 4+ years of proven experience in software testing, with a focus on AI modules.

- Strong understanding of AI and machine learning concepts.

- Proficiency in programming languages such as Python, Java.

- Experience with testing frameworks and tools (e. g., Selenium, BDD Cucumber).

- Familiarity with AI/ML libraries and frameworks (e. g., TensorFlow, PyTorch).

- Excellent analytical and problem-solving skills.

- Strong communication and teamwork abilities.

- Attention to detail and a commitment to quality.

Good to have :

- Knowledge about testing of Retrieval Augmented Generation pipelines, Agentic AI workflows, and concepts like Agent to Agent and Model Context Protocol.

- Knowledge of evaluation metrics like BLEU, ROUGE, METEOR, BERTScore, and COMET.

- Experience with cloud platforms (e. g., AWS, Azure, Google Cloud).

- Knowledge of data science and statistical analysis.

- Certification in software testing or AI/ML.

- Must have experience in : Java/ Python, Test Automation, AI/ML(TensorFlow, PyTorch), RAG, Cloud (AWS Preferred).

- Openness to learn and switching between programming languages and technologies as needed for the service development.