Program Manager II QA testing Account, Rufus and Alexa Ops
Job Summary
Key job responsibilities
Own stakeholder management for assigned business lines serve as primary QA coordination point manage expectations provide status updates and drive alignment
Manage the bug intake pipeline end-to-end: triage categorize prioritize and route defects; ensure tickets are SLA-compliant well-documented and properly closed
Drive bug verification workflows ensuring defects are validated and reproducible before escalation to engineering
Generate weekly/monthly QA reports for leadership covering defect trends escape rates test coverage and cycle time metrics
Analyze data to surface systemic gaps recurring patterns and areas of risk across supported business lines
Build and maintain dashboards providing real-time visibility into QA health and program readiness
Proactively identify gaps in test coverage process adherence and handoffs; recommend and implement improvements
Support launch readiness ad-hoc testing programs and peak event preparations through capacity tracking and milestone coordination
Document and standardize SOPs for QA account management processes
Contribute to WBR/MBR content and drive operational review discussions for QA metrics
About the team
Optima team in Rufus and Alexa Shopping Org strives to become the most reliable source for dataset generation and annotations. We work in collaboration with Shopping feature teams to enhance customer experience (CX) quality across shopping features devices and locales. Our primary focus lies in handling annotations for training measuring and improving Artificial Intelligence (AI) and Large Language Models (LLMs) enabling Amazon to deliver a superior shopping experience to customers worldwide. Our mission is to empower Amazons LLMs through Reinforcement Learning from Human Feedback (RLHF) across various categories at high speed. We aspire to provide an end-to-end data solution for the LLM lifecycle leveraging cutting-edge technology alongside our operational excellence. By joining us you will play a pivotal role in shaping the future of the shopping experience for customers worldwide.
- 3 years of program or project management experience
- 3 years of working cross functionally with tech and non-tech teams experience
- 3 years of defining and implementing process improvement initiatives using data and metrics experience
- Bachelors degree
- Knowledge of Excel (Pivot Tables VLookUps) at an advanced level and SQL
- Experience defining program requirements and using data and metrics to determine improvements
- 3 years of driving end to end delivery and communicating results to senior leadership experience
- 3 years of driving process improvements experience
- Experience in stakeholder management dealing with multiple stakeholders at varied levels of the organization
- Experience building processes project management and schedules
Our inclusive culture empowers Amazonians to deliver the best results for our customers. If you have a disability and need a workplace accommodation or adjustment during the application and hiring process including support for the interview or onboarding process please visit for more information. If the country/region youre applying in isnt listed please contact your Recruiting Partner.
Required Experience:
Manager
About Company
Free shipping on millions of items. Get the best of Shopping and Entertainment with Prime. Enjoy low prices and great deals on the largest selection of everyday essentials and other products, including fashion, home, beauty, electronics, Alexa Devices, sporting goods, toys, automotive ... View more