Are you passionate about delivering high-quality advertising experiences at scale? Join Amazon's Prime Video Ads QA team, where we ensure seamless ad delivery across millions of customers worldwide. As a Sr. Quality Assurance Engineer, you will:
- Design, develop, and maintain scalable test automation frameworks for Prime Video Ads platform, ensuring high coverage across functional, integration, and end-to-end testing.
- Lead org-level quality initiatives and define QA strategy & test plans across multiple concurrent projects, collaborating with engineering, product, and data science teams.
- Champion AI adoption in test automation — leveraging AI/ML tools to generate test cases, predict risk areas, detect anomalies, and accelerate defect resolution.
- Drive shift-left testing practices by embedding quality early in the software development lifecycle, including requirements review and design validation.
- Mentor and guide junior QA engineers, establishing best practices and quality standards across the team.
- Define and track quality metrics and KPIs, providing data-driven insights to stakeholders on release readiness.
- Partner with data science and ML teams to validate ad delivery algorithms, targeting logic, and measurement accuracy.
- Identify gaps in test coverage and proactively drive improvements to reduce customer-impacting defects.
- Contribute to CI/CD pipelines, ensuring automated tests are integrated and executed efficiently across build and deployment workflows.
Key job responsibilities
- Design, develop, and maintain scalable test automation frameworks for Prime Video Ads platform, ensuring high coverage across functional, integration, and end-to-end testing.
- Develop and maintain E2E automation scripts using TypeScript with Concierge/TREx for real device automation, leveraging a layered architecture (Components → Features → Tests) with VQA for visual validation, Sauron for stream data verification, and integrated reporting via ReportBuilder/TestRail — ensuring robust and maintainable test coverage across VOD, Live Events DAI, Linear DAI, and Interactive Video Ads on Prime Video Living Room devices.
- Lead quality initiatives and define QA strategy across multiple concurrent projects, collaborating with engineering, product, and data science teams.
- Champion AI adoption in test automation — leveraging AI/ML tools to generate test cases, predict risk areas, detect anomalies, and accelerate defect resolution.
- Drive shift-left testing practices by embedding quality early in the software development lifecycle, including requirements review and design validation.
- Mentor and guide junior QA engineers, establishing best practices and quality standards across the team.
- Define and track quality metrics and KPIs, providing data-driven insights to stakeholders on release readiness.
- Partner with data science and ML teams to validate ad delivery algorithms, targeting logic, and measurement accuracy.
- Contribute to CI/CD pipelines, ensuring automated tests are integrated and executed efficiently across build and deployment workflows.
A day in the life
As a Sr. QAE on the Prime Video Ads team, your day involves collaborating with engineers, program and product managers to review requirements, identify risks early, and define test strategies. You'll write and review automation scripts, triage failures in CI/CD pipelines, and leverage AI tools to improve test coverage. You will optimize QA processes using AI adoption. You'll participate in sprint ceremonies, contribute to design reviews, and mentor junior QA engineers. You'll also partner with data science teams to validate ad delivery and measurement accuracy, and present quality metrics to stakeholders to drive release readiness decisions.
About the team
The Prime Video Ads QA team is at the forefront of ensuring seamless and high-quality advertising experiences for millions of customers worldwide. We are a passionate group of quality engineers who thrive on innovation, collaboration, and continuous improvement. Our team works closely with engineering, product, and data science teams to deliver reliable and impactful advertising solutions at scale. We embrace a culture of ownership, where every team member is empowered to drive quality initiatives and make a meaningful impact. We are committed to leveraging AI/ML tools and automation to stay ahead in a fast-paced, ever-evolving landscape.
- 6+ years of quality assurance engineering experience
- 4+ years of delivering test frameworks, test tools, leading the QA projects and initiatives experience
- Bachelor's degree
- Knowledge of QA methodology and tools, with demonstrated experience in an QAE role
- Experience in manual testing
- Experience in automation testing
- 2+ years of UI Automation (preferably on mobile platforms) experience
- Knowledge of at least one modern object-oriented programming language such as C++, Java, Objective C
Amazon is an equal opportunity employer and does not discriminate on the basis of protected veteran status, disability, or other legally protected status.
Our inclusive culture empowers Amazonians to deliver the best results for our customers. If you have a disability and need a workplace accommodation or adjustment during the application and hiring process, including support for the interview or onboarding process, please visit https://amazon.jobs/content/en/how-we-hire/accommodations for more information. If the country/region you’re applying in isn’t listed, please contact your Recruiting Partner.
The base salary range for this position is listed below. Your Amazon package will include sign-on payments and restricted stock units (RSUs). Final compensation will be determined based on factors including experience, qualifications, and location. Amazon also offers comprehensive benefits including health insurance (medical, dental, vision, prescription, Basic Life & AD&D insurance and option for Supplemental life plans, EAP, Mental Health Support, Medical Advice Line, Flexible Spending Accounts, Adoption and Surrogacy Reimbursement coverage), 401(k) matching, paid time off, and parental leave. Learn more about our benefits at https://amazon.jobs/en/benefits.
USA, VA, Arlington - 133,300.00 - 180,300.00 USD annually