Bug Book
← Current Breakdown

AI chat responds in English instead of French

Type of Test

Interactions

AI Feature Error

Agents used

AI Feature Testing
AI Feature Testing

Bug Impact Potential

Workout Brand Website
Connected
Before
After

Compare

Workout Brand Website
Connected
Workout Brand Website
Connected

Step the Agent Failed on:

  • 5 Verify the AI Chat response is also in [Language: French]
Test Failed
Test Warning
Test Success

End-to-end checkout Flow

Full Test That Was Run:

Test Failed

The AI chatbot responds in English, despite the user initiating the conversation in French.

Test Successed

The AI chatbot responds in English, despite the user initiating the conversation in French.

  • 1 Wait for the page to load
  • 2 If there's any cookie banners present at the bottom of the page, click on "Accept"
  • 3 Click on the round black chat icon in the bottom right corner of the page, it is small and on the page. It is the small round icon to open up a chatbot window
  • 4 Translate hi in [Language: French] and type it into the chatbox and submit
  • 5 Verify the AI Chat response is also in [Language: French]

Bug Book

These are production bugs found for our actual customers

Explore Bugs Caught
AI Feature Testing

Search results for “gaming console” show accessories instead of consoles

See Full Test
UI/UX Testing

Multiple UI/UX inconsistencies on international pricing page

See Full Test
AI Feature Testing

AI chat responds in English instead of French

See Full Test
Exploratory Testing

“Best Sellers” link in header leads to a 404 page

See Full Test
Functional Testing

Checkout shows incorrect price or currency for Germany shoppers

See Full Test
Localization

French (Belgium) users see incorrect language during checkout

See Full Test
AI Feature Testing

Chat responses fail during long conversations

See Full Test
Functional Testing

Liked Item Missing From Favorites

See Full Test
Exploratory Testing

Meal selection page stuck loading

See Full Test
Functional Testing

Delivery date is not displayed correctly

See Full Test
Functional Testing

Subscription plan displays raw template text

See Full Test
Exploratory Testing

Rewards page shows incorrect annual redemption limit

See Full Test

Platform: Native Mobile App (Android)
Device: Pixel 4a
Android Version: 35
User Type: Tobacco Member
Test Result: Failed at step 5 - Points display configuration error

AI Feature Testing

Afternoon time slots don’t appear when selected

See Full Test

Platform: Web Browser
Website: Rockefeller Center
Test Type: E2E Purchase Flow

Functional Testing

Total cost shown is wrong at checkout

See Full Test
Exploratory Testing

Checkout button leads to error page

See Full Test

Checkout completion rate, conversion rate, revenue

Functional Testing

Checkout total is higher than expected

See Full Test

Revenue accuracy, pricing accuracy, discount validation, checkout conversion rate

Exploratory Testing

Reviews reference a different item (dress) on shorts page

See Full Test
  • Prevented over $400k in lost sales
  • Saved 21 hours in dev time on the bug
  • Automated 21 hours in dev time on the bug
Previous
Next

Schedule A Demo

We invite you to try us out with our new Pilot Program

Book A Demo