News | The 2026 Buyers Guide to E-Commerce QA

Spur caught the AI chatbot replying in English instead of French

Bug Book — Alo

A French-speaking customer opens the chat, says bonjour, and gets an English response back. The chatbot wasn't picking up on the language of the conversation and defaulting to English.

TYPE OF TEST

Interactions AI Feature Error

AGENTS USED

AI Feature Testing

SEVERITY

Medium

What this run

has verified.

Spur's AI Feature Testing agent opened the chatbot, sent a message in French, and checked whether the response came back in the same language. It didn't, the chatbot replied in English.

Language detection

The chatbot identifying and matching the language of the user's message.

Response accuracy

Chat replies coming back in the same language the customer wrote in.

Localisation

The AI feature behaving correctly across all supported languages.

Customer experience

French-speaking users getting a response they can actually read.

Compare

The customer's live site,

captured by

Spur

during the run.

Spur Agent Analysis

Failure reason: The chatbot was greeted in French ("bonjour") but replied in English, its language detection failed to pick up the conversation's language and defaulted to English, so French-speaking customers reaching out for help got a response they may not be able to read.

5 - Step failed

What this

one catch saved.

5hrs

Dev time saved

Shipped, this is a subtle one to reproduce: you need to test the chatbot in multiple languages and notice it's not mirroring back. That's a few hours of debugging the language detection layer in the AI integration.

Undermined

Customer experience

French-speaking customers hitting a chatbot that ignores their language and replies in English get a clear signal: this product wasn't built with them in mind.

3hrs

Manual QA time

Finding this manually means opening the chat in each supported language and reading responses carefully enough to catch the mismatch, easy to skip if you're only testing the happy path in English.

The actual test

in

Language Mismatch

A 5-step AI feature test on a workout brand's site. Spur opened the chat widget, typed a greeting in French, and verified the response language matched. It didn't, the chatbot replied in English despite being addressed in French.

Wait for the page to load

If there's any cookie banners present at the bottom of the page, click on "Accept"

Click on the round black chat icon in the bottom right corner of the page, it is small and on the page. It is the small round icon to open up a chatbot window

Translate hi in {review_summary} and type it into the chatbox and submit