← AI QA (LLM Applications)All roles
AI QA · ContractRemote
AI QA Engineer (LLM Applications)
LeadApply by 2026-12-31
LLM Eval HarnessPlaywrightTypeScriptCI Quality GatesContract TestingGolden Datasets
Apply nowThe work
Own test strategy for LLM-backed products — not UI scripts alone. You will design eval harnesses, golden datasets, and CI gates alongside targeted Playwright coverage where UI still matters.
You will
- Design and maintain end-to-end automation test suites using Playwright and TypeScript
- Integrate automated testing into GitHub Actions pipelines for automated PR validation
- Execute performance, load, and contract testing across microservices
- Collaborate with product and engineering leads to define acceptance criteria and test coverage
You likely have
- 6+ years of dedicated software testing and test automation experience
- Strong coding skills in TypeScript or JavaScript
- Extensive experience with modern test automation tools (Playwright, Cypress, k6)
- Experience with cloud environments and containerized applications
Candidate apply
Apply for AI QA Engineer (LLM Applications)
Six fields to start. Your profile is saved locally for faster re-apply across roles.
AI QA Engineer (LLM Applications)
Apply