Reviews reference a different item (dress) on shorts page
Type of Test
Copy
Payment
Agents used
Bug Impact Potential
Potentially risking $250,000 of lost in sales if the bug was not spotted and fixed.
Step the Agent Failed on:
- 9 Verify review_summary and number_of_reviews are displayed
Metrics Achieved
Spur was responsible for:
- Prevented over $400k in lost sales
- Saved 21 hours in dev time on the bug
- Automated 21 hours in dev time on the bug
End-to-end checkout Flow
Full Test That Was Run:
The review summary extracted earlier refers to a dress, but the current product is "3" High-Waist Airlift Short". The specific review summary about dress versatility, fall weddings, and girls night out is not displayed on this page because it's not relevant to the shorts product being viewed.
The review summary extracted earlier refers to a dress, but the current product is "3" High-Waist Airlift Short". The specific review summary about dress versatility, fall weddings, and girls night out is not displayed on this page because it's not relevant to the shorts product being viewed.
- 1 Close the password page if present, then wait for homepage to load
- 2 Redirect to: https://qa.activewear.com/products/high-waist-airlift-short-black
- 3 Verify there are star ratings displayed next to the price, along with a reviews count in parentheses, and a Review Summary hyperlink
- 4 Click on Review Summary
- 5 Verify a Size & Fit Average modal appears with a Size bar rating and a Review Highlights summary, and a View All Reviews CTA
- 6 Extract {review_summary}
- 7 Extract {number_of_reviews}
- 8 Click on View All Reviews
- 9 Verify review_summary and number_of_reviews are displayed
- 10 Verify a ratings snapshot and overall rating is displayed
- 11 Scroll down to the customer generated reviews section
- 12 Verify ratings are displayed with product relevant reviews, including customer name, ratings, timezone, a title, a helpful up and downvote, a Report hyperlink, a Fit slider, a Sort By dropdown, and some filters
Bug Book
These are production bugs found for our actual customers
Search results for “gaming console” show accessories instead of consoles
Multiple UI/UX inconsistencies on international pricing page
AI chat responds in English instead of French
“Best Sellers” link in header leads to a 404 page
Checkout shows incorrect price or currency for Germany shoppers
French (Belgium) users see incorrect language during checkout
.avif)
Chat responses fail during long conversations
Liked Item Missing From Favorites
Meal selection page stuck loading
Delivery date is not displayed correctly
Subscription plan displays raw template text
Rewards page shows incorrect annual redemption limit
Platform: Native Mobile App (Android)
Device: Pixel 4a
Android Version: 35
User Type: Tobacco Member
Test Result: Failed at step 5 - Points display configuration error
Afternoon time slots don’t appear when selected
Platform: Web Browser
Website: Rockefeller Center
Test Type: E2E Purchase Flow
Total cost shown is wrong at checkout
Checkout button leads to error page
Checkout completion rate, conversion rate, revenue
Checkout total is higher than expected
Revenue accuracy, pricing accuracy, discount validation, checkout conversion rate
Reviews reference a different item (dress) on shorts page
- Prevented over $400k in lost sales
- Saved 21 hours in dev time on the bug
- Automated 21 hours in dev time on the bug
Schedule A Demo
We invite you to try us out with our new Pilot Program
