Qentelli - Quality Assurance Architect

Experience :

- 10+ years of professional experience in quality engineering, test architecture, or software engineering with a deep quality specialism with at least 3 of those years operating at a principal, staff, or architect level where you designed the testing strategy for a platform-scale system, not just a single application.

Job Description :

- Demonstrable experience testing AI or ML systems : you have designed test strategies for systems whose outputs are probabilistic, you have built evaluation frameworks that go beyond simple assertion-based testing, and you have confronted and solved the question of what 'correct' means for a generative AI output. You do not need to have worked on an agentic multi-LLM system specifically, but you need to arrive ready to design one.

- People leadership experience : you have technically led a team of at least three engineers setting quality direction, reviewing test designs, unblocking environment issues, managing cross-team dependencies, and developing individual skills. The three direct reports in this role (manual testers, performance tester, security tester) span three distinct disciplines; you need to be credible across all three.

- End-to-end CI/CD quality gate ownership : you have designed the quality gate architecture for a real CI/CD pipeline not just contributed tests to one someone else designed. You have made the trade-offs between coverage, speed, and cost, and you have been accountable for the consequences when a gate missed a production defect.

- Distributed system testing experience : you have tested systems with multiple backend services, asynchronous event flows, and at least one data store whose consistency model complicates test assertions and you have designed test isolation strategies that make those tests reliable without requiring a full production-scale environment.

- Performance testing literacy : you have worked alongside performance engineers closely enough to review load test designs, interpret P95 latency results in the context of system architecture, and make informed decisions about which performance regressions block a release. You do not need to write k6 scripts daily, but you need to be able to evaluate whether the ones your Performance Test Engineer writes are testing the right things.

- Application security testing literacy : you have worked closely enough with security engineers to review SAST findings triage decisions, understand what makes a penetration test finding exploitable versus theoretical, and participate meaningfully in a threat modelling session. You do not need to run ZAP scans yourself, but you need to be able to set coverage expectations for the person who does.

Education :

- Bachelor's degree in Computer Science, Software Engineering, or a related technical discipline OR equivalent practical experience demonstrated through portfolio, professional references, and interview performance.

- Relevant certifications ISTQB Advanced Level Test Manager, ISTQB Advanced Level Test Architect, AWS DevOps Engineer Professional, or equivalent are a positive signal. A candidate who has designed and published an eval framework for an LLM application will be weighted ahead of one who has not, regardless of certification.