Search results for “gaming console” show accessories instead of consoles
Step the Agent Failed on:
- 3 Check that the results shown are for gaming consoles and select any gaming console
End-to-end checkout Flow
Full Test That Was Run:
When searching for “gaming console”, the results return accessories (e.g., a cleaning kit) instead of actual gaming console devices. This breaks user expectations and makes it difficult for users to find relevant products.
When searching for “gaming console”, the results return accessories (e.g., a cleaning kit) instead of actual gaming console devices. This breaks user expectations and makes it difficult for users to find relevant products.
- 1 Accept all the cookies and close any promo banners that interfere with the test through out the test
- 2 Search for gaming console
- 3 Check that the results shown are for gaming consoles and select any gaming console
- 4 Extract {Product_Name}, {Product_Price}
- 5 Add the item to the cart and proceed to checkout
- 6 Check that the product name and product price on the checkout page matches Product_Name and Product_Price
Bug Book
These are production bugs found for our actual customers
Search results for “gaming console” show accessories instead of consoles
Multiple UI/UX inconsistencies on international pricing page
AI chat responds in English instead of French
“Best Sellers” link in header leads to a 404 page
Checkout shows incorrect price or currency for Germany shoppers
French (Belgium) users see incorrect language during checkout
.avif)
Chat responses fail during long conversations
Liked Item Missing From Favorites
Meal selection page stuck loading
Delivery date is not displayed correctly
Subscription plan displays raw template text
Rewards page shows incorrect annual redemption limit
Platform: Native Mobile App (Android)
Device: Pixel 4a
Android Version: 35
User Type: Tobacco Member
Test Result: Failed at step 5 - Points display configuration error
Afternoon time slots don’t appear when selected
Platform: Web Browser
Website: Rockefeller Center
Test Type: E2E Purchase Flow
Total cost shown is wrong at checkout
Checkout button leads to error page
Checkout completion rate, conversion rate, revenue
Checkout total is higher than expected
Revenue accuracy, pricing accuracy, discount validation, checkout conversion rate
Reviews reference a different item (dress) on shorts page
- Prevented over $400k in lost sales
- Saved 21 hours in dev time on the bug
- Automated 21 hours in dev time on the bug
Schedule A Demo
We invite you to try us out with our new Pilot Program
