Bug Book
← Current Breakdown

Checkout total is higher than expected

Type of Test

Pricing

Checkout

Agents used

Functional Testing
Functional Testing

Bug Impact Potential

CRITICAL - Pricing and discount validation error causing $200 overcharge. Customers are being charged $200 more than expected due to incorrect pricing display ($100 extra per product) and incorrect discount amounts ($100 less discount per product). This directly impacts customer trust, revenue accuracy, and could lead to chargebacks and brand damage.

Eight Sleep BCFM Testing Site
Connected
Before
After

Compare

Eight Sleep BCFM Testing Site
Connected
Eight Sleep BCFM Testing Site
Connected

Step the Agent Failed on:

  • 14.1 Clicked checkout button - Pricing validation

Metrics Achieved

Spur was responsible for:

Revenue accuracy, pricing accuracy, discount validation, checkout conversion rate

Test Failed
Test Warning
Test Success

End-to-end checkout Flow

Full Test That Was Run:

Test Failed

Pricing and discount discrepancy on checkout page. The prices shown on the checkout page do not match the prices extracted during product configuration: 1. Pod 5 Core: Expected $2,549 but showing $2,649.00 (+$100 difference) 2. Pod Pillow Cover: Expected $849 but showing $949.00 (+$100 difference) 3. Discount amounts are incorrect: - Pod 5 Core discount: Showing -$600 instead of -$700 (advertised as $700 OFF) - Pod Pillow Cover discount: Showing -$100 instead of -$200 (advertised as $200 OFF) - Total discount: Showing -$700.00 instead of -$900 (sum of advertised discounts) This results in customers being charged $200 more than expected based on the advertised discount amounts displayed during product selection.

Test Successed

Pricing and discount discrepancy on checkout page. The prices shown on the checkout page do not match the prices extracted during product configuration: 1. Pod 5 Core: Expected $2,549 but showing $2,649.00 (+$100 difference) 2. Pod Pillow Cover: Expected $849 but showing $949.00 (+$100 difference) 3. Discount amounts are incorrect: - Pod 5 Core discount: Showing -$600 instead of -$700 (advertised as $700 OFF) - Pod Pillow Cover discount: Showing -$100 instead of -$200 (advertised as $200 OFF) - Total discount: Showing -$700.00 instead of -$900 (sum of advertised discounts) This results in customers being charged $200 more than expected based on the advertised discount amounts displayed during product selection.

  • 1 Redirect to Eight Sleep site
  • 2 Wait for page to fully load and close any popups
  • 3 Click on Shop the Pod or Shop the Sale
  • 4 Extract {Pod5Core_Discount}, {Pod5Ultra_Discount}
  • 5 Verify that the value of the Pod5Core_Discount matches [Pod5_DiscountPill: $700 OFF] and that the value of Pod5Ultra_Discount matches [Pod5_Ultra_DiscountPill: $800 OFF]
  • 6 Choose Pod5 Core or skip if already selected
  • 7 Choose the largest size and scroll up to perform extraction
  • 8 Extract Price_POD5Core
  • 9 Scroll down to add-ons section
  • 10 Extract {Blanket_Discount}, {Pillow_Discount}
  • 11 Verify that the value of the Blanket_Discount matches [Blanket_DiscountPill: $200 OFF] and that the value of Pillow_Discount matches [PillowCover_DiscountPill: $200 OFF]
  • 12 Select random Add On (Blanket or Pod Pillow Cover)
  • 13 Extract {Price_AddOn}
  • 14 Click on Checkout
  • 15 Verify that the right prices and discounts are shown at checkout

Bug Book

These are production bugs found for our actual customers

Explore Bugs Caught
AI Feature Testing

Search results for “gaming console” show accessories instead of consoles

See Full Test
UI/UX Testing

Multiple UI/UX inconsistencies on international pricing page

See Full Test
AI Feature Testing

AI chat responds in English instead of French

See Full Test
Exploratory Testing

“Best Sellers” link in header leads to a 404 page

See Full Test
Functional Testing

Checkout shows incorrect price or currency for Germany shoppers

See Full Test
Localization

French (Belgium) users see incorrect language during checkout

See Full Test
AI Feature Testing

Chat responses fail during long conversations

See Full Test
Functional Testing

Liked Item Missing From Favorites

See Full Test
Exploratory Testing

Meal selection page stuck loading

See Full Test
Functional Testing

Delivery date is not displayed correctly

See Full Test
Functional Testing

Subscription plan displays raw template text

See Full Test
Exploratory Testing

Rewards page shows incorrect annual redemption limit

See Full Test

Platform: Native Mobile App (Android)
Device: Pixel 4a
Android Version: 35
User Type: Tobacco Member
Test Result: Failed at step 5 - Points display configuration error

AI Feature Testing

Afternoon time slots don’t appear when selected

See Full Test

Platform: Web Browser
Website: Rockefeller Center
Test Type: E2E Purchase Flow

Functional Testing

Total cost shown is wrong at checkout

See Full Test
Exploratory Testing

Checkout button leads to error page

See Full Test

Checkout completion rate, conversion rate, revenue

Functional Testing

Checkout total is higher than expected

See Full Test

Revenue accuracy, pricing accuracy, discount validation, checkout conversion rate

Exploratory Testing

Reviews reference a different item (dress) on shorts page

See Full Test
  • Prevented over $400k in lost sales
  • Saved 21 hours in dev time on the bug
  • Automated 21 hours in dev time on the bug
Previous
Next

Schedule A Demo

We invite you to try us out with our new Pilot Program

Book A Demo