V

QA Analyst for LOIS

Virtual Vocations
3 hours ago
Remote
United States

Owning the quality assurance function for LOIS for Word, the full-time remote QA Analyst will define test strategies, evaluate AI output accuracy, and collaborate with product and engineering teams to ensure quality is integrated from the start of feature development.Key responsibilities:Define and own the test strategy, process, and QA playbook for the productEvaluate AI output quality and design evaluation sets to catch regressions over timeBuild automated guardrails integrated into CI/CD that cover critical flowsRequired qualifications:2+ years of QA experience, including ownership of test strategy for a product or major feature areaTrack record of building QA processes and automation from scratch in a fast-moving environmentStrong analytical skills with a focus on both functional correctness and AI output qualityAbility to reason about non-deterministic systems and define what "correct" means in ambiguous scenariosExperience with bug tracking tools and test management workflows