Help Center Check · study

How long do AI answers stay wrong after a policy changes?

We built a test store, Quillmere Outfitters, with a public return policy. Then we changed one condition, the return window from 30 days to 14, and asked AI assistants about it before and after. This page shows every answer we recorded, read in code, and it updates as the daily probes arrive.

Status

  • Store published: Nov 2, 02:37 PM UTC (version 1, 30 days).
  • Condition changed: Nov 2, 03:41 PM UTC (version 2, 14 days).
  • Probes recorded: 68 (28 before the change, 40 after, in 2 rounds). Provider cost so far: $0.15 where the provider reports it.
  • After the change we probe once a day for 30 days.

Results: the changed condition (Q1, the return window)

“Current” before the change means 30 days; after it, 14 days. Hover a cell for the answer.

AssistantAskedBefore the changeAfter the changeStale answers afterFirst current answer
Perplexity (Sonar API)with the page addressnot foundnot found (latest of 2)0 of 2not yet
Perplexity (Sonar API)by store name onlynot foundnot found (latest of 2)0 of 2not yet
Google Gemini (API, Google Search grounding)with the page addresscurrent (30 days)current (latest of 2)0 of 20 h after
Google Gemini (API, Google Search grounding)by store name onlynot foundnot found (latest of 2)0 of 2not yet
OpenAI (Responses API, web search)with the page addresscurrent (30 days)current (latest of 2)1 of 20.8 h after
OpenAI (Responses API, web search)by store name onlynot foundnot found (latest of 2)0 of 2not yet
Anthropic Claude (API, web search and web fetch)with the page addresscurrent (30 days)current (latest of 2)0 of 20 h after
Anthropic Claude (API, web search and web fetch)by store name onlynot foundnot found (latest of 2)0 of 2not yet
xAI Grok (Responses API, web search)with the page addresscurrent (30 days)old: 30 days (latest of 2)2 of 2not yet
xAI Grok (Responses API, web search)by store name onlynot foundnot found (latest of 2)0 of 2not yet

Control: an unchanged condition (Q2, refund timing)

AssistantAskedBeforeAfter
Perplexity (Sonar API)with the page addressnot found (latest of 3)not found (latest of 2)
Perplexity (Sonar API)by store name onlynot found (latest of 3)not found (latest of 2)
Google Gemini (API, Google Search grounding)with the page addresscurrentcurrent (latest of 2)
Google Gemini (API, Google Search grounding)by store name onlyneithernot found (latest of 2)
OpenAI (Responses API, web search)with the page addresscurrentcurrent (latest of 2)
OpenAI (Responses API, web search)by store name onlynot foundnot found (latest of 2)
Anthropic Claude (API, web search and web fetch)with the page addresscurrentcurrent (latest of 2)
Anthropic Claude (API, web search and web fetch)by store name onlynot foundnot found (latest of 2)
xAI Grok (Responses API, web search)with the page addresscurrentcurrent (latest of 2)
xAI Grok (Responses API, web search)by store name onlynot foundnot found (latest of 2)

Who read the store page

Visits to the store page by user-agent family (nothing else is recorded about a visit).

  • Browser: 18
  • ClaudeBot / Claude-User: 7
  • GPTBot / OAI-SearchBot / ChatGPT-User: 6
  • Other bot: 4

Method

  • The store. https://www.xyntherium.com/help-center-check/study/store is a single return-policy page for Quillmere Outfitters, labeled as a test store. It is in our sitemap and open to every crawler. Version 1 says returns are accepted within 30 days of delivery; version 2 changes only that window, to 14 days, and the page’s “last updated” date.
  • The questions. “How many days do I have to return an item to Quillmere Outfitters?” (the changed condition) and “How long does Quillmere Outfitters take to issue a refund after it receives a return?” (a control that did not change). Each is asked two ways: with the page address added (“The store's return policy is at https://www.xyntherium.com/help-center-check/study/store”) and by store name only.
  • The assistants. Their public APIs with web access turned on, one call per question: Perplexity (Sonar API), sonar; Google Gemini (API, Google Search grounding), gemini-2.5-flash; OpenAI (Responses API, web search), gpt-5.4-mini; Anthropic Claude (API, web search and web fetch), claude-haiku-5-5; xAI Grok (Responses API, web search), grok-4.3. Instructions to every assistant: “Answer the customer question in two sentences or fewer. Use the web. If you cannot find the information, say that you could not find it.”
  • Reading the answers. In code, with no model: an answer is “old” when it says 30 days, “current” when it says 14 days (after the change), “both”, “neither”, or “not found” when the assistant says it could not find the store or the policy. The control is right when it says 5 business days. Hyphenated forms (“30-day”, “5-business-day”) count, and an answer that never names Quillmere is about something else (“neither”). Every answer is read with the same code, and every answer is listed below.
  • Schedule. One round before the change, one right after it, then one a day for 30 days. Every answer is kept, including errors.
  • AI support bots. Not run yet: each needs a trial account, which we have not opened. Platforms that need a sales call are skipped.
    • Intercom Fin: Self-serve trial exists; needs an account (owner step)
    • Zendesk AI agents: Self-serve trial exists; needs an account (owner step)
    • Tidio Lyro: Free tier exists; needs an account (owner step)
    • Chatbase: Free tier with an API; needs an account (owner step)
    • Gorgias: Self-serve trial exists; needs an account (owner step)
    • Ada, Forethought, Sierra, Decagon: Skipped: a sales call is required
  • Limits. A new page on our own domain is not representative of a store search engines have known for years. API answers can differ from the consumer apps. One store and one change are an illustration, not a survey.

Every answer

Show all 68 recorded answers
  • Nov 2, 02:58 PM UTC · v1 · Perplexity (Sonar API) · with address · q1-window · error

    Request rate limit exceeded, please try again later.

  • Nov 2, 02:58 PM UTC · v1 · Perplexity (Sonar API) · by name · q1-window · error

    Request rate limit exceeded, please try again later.

  • Nov 2, 02:58 PM UTC · v1 · Perplexity (Sonar API) · by name · q2-refund-time · error

    Request rate limit exceeded, please try again later.

  • Nov 2, 02:58 PM UTC · v1 · Perplexity (Sonar API) · with address · q2-refund-time · not found

    I could not find Quillmere Outfitters’ return policy or a store-specific refund timeframe at the provided URL.

  • Nov 2, 02:58 PM UTC · v1 · Google Gemini (API, Google Search grounding) · with address · q1-window · old: 30 days

    You have 30 days from the delivery date to return unworn items to Quillmere Outfitters for a full refund.

  • Nov 2, 02:58 PM UTC · v1 · Google Gemini (API, Google Search grounding) · by name · q1-window · not found

    I could not find information on the return policy for "Quillmere Outfitters." The search results provided information for several other "Outfitters" branded companies with varying return policies.

  • Nov 2, 02:58 PM UTC · v1 · Google Gemini (API, Google Search grounding) · with address · q2-refund-time · current

    Once Quillmere Outfitters receives a returned item at their warehouse, refunds are issued within 5 business days.

  • Nov 2, 02:58 PM UTC · v1 · Google Gemini (API, Google Search grounding) · by name · q2-refund-time · neither

    After Quillmere Outfitters receives your return, please allow up to fourteen days for the warehouse to accept, inspect, and process it.

  • Nov 2, 02:59 PM UTC · v1 · OpenAI (Responses API, web search) · by name · q1-window · not found

    I couldn’t find a return policy specifically for **Quillmere Outfitters**. If you meant a different retailer with a similar name, send me the exact website or a link and I’ll look it up.

  • Nov 2, 02:59 PM UTC · v1 · OpenAI (Responses API, web search) · with address · q1-window · old: 30 days

    You have **30 days from delivery** to return an unworn item for a full refund. The policy is on the store page and was last updated **November 2, 2026**. ([xyntherium.com](https://www.xyntherium.com/answer-watch/study/store))

  • Nov 2, 02:59 PM UTC · v1 · OpenAI (Responses API, web search) · by name · q2-refund-time · not found

    I couldn’t find a reliable refund policy page for **Quillmere Outfitters** specifically. If you meant a different retailer or can share the exact website, I can look it up.

  • Nov 2, 02:59 PM UTC · v1 · OpenAI (Responses API, web search) · with address · q2-refund-time · current

    Quillmere Outfitters says refunds are issued **within 5 business days after the return reaches its warehouse**. ([xyntherium.com](https://www.xyntherium.com/answer-watch/study/store))

  • Nov 2, 02:59 PM UTC · v1 · Anthropic Claude (API, web search and web fetch) · with address · q1-window · old: 30 days

    Quillmere's policy page gives you 30 days from delivery to send back unworn items, with the original tags attached, for a full refund. The page also describes Quillmere as a test store for a public study that sells nothing, so this policy may not apply to a real purchase.

  • Nov 2, 02:59 PM UTC · v1 · Anthropic Claude (API, web search and web fetch) · by name · q2-refund-time · not found

    I could not find Quillmere Outfitters' refund timing in my search results. The results covered similarly named retailers, such as Quill & Courier and Outfitters USA, but those policies may not apply to Quillmere, so please check its official returns page or contact its customer service.

  • Nov 2, 02:59 PM UTC · v1 · Anthropic Claude (API, web search and web fetch) · by name · q1-window · not found

    I could not find a return policy for Quillmere Outfitters. My searches only returned policies for similarly named companies, such as Quill.com and Quill Clothing Co., which don't apply to your question. Please check the company's website or contact its customer service directly.

  • Nov 2, 02:59 PM UTC · v1 · Anthropic Claude (API, web search and web fetch) · with address · q2-refund-time · current

    Quillmere's returns page says it begins the 5-business-day refund clock when the return reaches its warehouse, not when you ship it. The page also describes Quillmere as a test store for a public study that sells nothing, so this is a sample policy rather than a live store.

  • Nov 2, 02:59 PM UTC · v1 · xAI Grok (Responses API, web search) · by name · q2-refund-time · not found

    **I could not find any information on "Quillmere Outfitters" or its refund/return policy.**[[1]](https://www.quilloutfitters.com/hunt) No matching company, website, or policy details appear in web searches.

  • Nov 2, 02:59 PM UTC · v1 · xAI Grok (Responses API, web search) · by name · q1-window · not found

    **I could not find any information on Quillmere Outfitters or its return policy.** No matching company or policy appears in web results.

  • Nov 2, 02:59 PM UTC · v1 · xAI Grok (Responses API, web search) · with address · q1-window · old: 30 days

    You have 30 days from delivery to return unworn items to Quillmere Outfitters for a full refund.[[1]](https://www.xyntherium.com/answer-watch/study/store)

  • Nov 2, 02:59 PM UTC · v1 · xAI Grok (Responses API, web search) · with address · q2-refund-time · current

    **Quillmere Outfitters issues refunds within 5 business days once a return reaches their warehouse.**[[1]](https://www.xyntherium.com/answer-watch/study/store)

  • Nov 2, 02:59 PM UTC · v1 · Perplexity (Sonar API) · with address · q2-refund-time · error

    Request rate limit exceeded, please try again later.

  • Nov 2, 02:59 PM UTC · v1 · Perplexity (Sonar API) · with address · q1-window · not found

    I could not find Quillmere Outfitters’ return policy or a stated return period at the provided webpage.

  • Nov 2, 02:59 PM UTC · v1 · Perplexity (Sonar API) · by name · q2-refund-time · error

    Request rate limit exceeded, please try again later.

  • Nov 2, 02:59 PM UTC · v1 · Perplexity (Sonar API) · by name · q1-window · not found

    I could not find a return policy for Quillmere Outfitters, so I can’t confirm how many days you have to return an item.

  • Nov 2, 03:40 PM UTC · v1 · Perplexity (Sonar API) · with address · q1-window · not found

    I could not find Quillmere Outfitters’ return policy at the provided webpage, so I can’t determine the return window.

  • Nov 2, 03:40 PM UTC · v1 · Perplexity (Sonar API) · by name · q1-window · not found

    I could not find a published return policy for Quillmere Outfitters, so I can’t confirm how many days you have to return an item.

  • Nov 2, 03:40 PM UTC · v1 · Perplexity (Sonar API) · with address · q2-refund-time · not found

    I could not find Quillmere Outfitters’ return policy or a specific refund-issuance timeframe at the provided URL.

  • Nov 2, 03:41 PM UTC · v1 · Perplexity (Sonar API) · by name · q2-refund-time · not found

    I could not find a published refund timeframe for Quillmere Outfitters. General guidance suggests refunds commonly take 5–14 business days after the retailer receives and processes the return.[3]

  • Nov 2, 03:41 PM UTC · v2 · Perplexity (Sonar API) · with address · q1-window · not found

    I could not find Quillmere Outfitters’ return policy or verify the number of days from the provided page.

  • Nov 2, 03:41 PM UTC · v2 · Google Gemini (API, Google Search grounding) · by name · q1-window · neither

    You have 90 days from the delivery date to return an item to Quillmore under their satisfaction guarantee, provided the product has original tags and is in new or lightly used condition. For customers in the EU/EEA and UK, you also have a statutory right of withdrawal, allowing returns within 14 days of receipt for a full refund, including original delivery costs.

  • Nov 2, 03:41 PM UTC · v2 · Google Gemini (API, Google Search grounding) · by name · q2-refund-time · not found

    I could not find specific information regarding how long Quillmere Outfitters takes to issue a refund after receiving a return. The search results provided information for several different "Outfitters" companies, but not for "Quillmere Outfitters" directly.

  • Nov 2, 03:41 PM UTC · v2 · Google Gemini (API, Google Search grounding) · with address · q2-refund-time · current

    Quillmere Outfitters issues refunds within 5 business days once a return reaches their warehouse.

  • Nov 2, 03:41 PM UTC · v2 · Perplexity (Sonar API) · by name · q1-window · not found

    I could not find a verified return policy for Quillmere Outfitters, so I can’t determine how many days you have to return an item.

  • Nov 2, 03:41 PM UTC · v2 · Google Gemini (API, Google Search grounding) · with address · q1-window · current

    You have 14 days from the date of delivery to return unworn items to Quillmere Outfitters for a full refund. Items must be unworn, unwashed, and have their original tags attached.

  • Nov 2, 03:41 PM UTC · v2 · Perplexity (Sonar API) · with address · q2-refund-time · not found

    I could not find Quillmere Outfitters’ return policy or a stated refund timeframe at the provided URL.

  • Nov 2, 03:41 PM UTC · v2 · OpenAI (Responses API, web search) · with address · q1-window · old: 30 days

    You have **30 days from delivery** to return an item to Quillmere Outfitters. ([xyntherium.com](https://www.xyntherium.com/answer-watch/study/store))

  • Nov 2, 03:41 PM UTC · v2 · OpenAI (Responses API, web search) · with address · q2-refund-time · current

    Quillmere Outfitters says refunds are issued within **5 business days** after the return reaches its warehouse. ([xyntherium.com](https://www.xyntherium.com/answer-watch/study/store))

  • Nov 2, 03:41 PM UTC · v2 · Perplexity (Sonar API) · by name · q2-refund-time · not found

    I could not find a published refund timeframe specific to Quillmere Outfitters. General guidance suggests refunds are typically issued within 2–10 business days after the return is received and inspected, with additional time for the bank to post the credit.[3]

  • Nov 2, 03:41 PM UTC · v2 · OpenAI (Responses API, web search) · by name · q1-window · not found

    I couldn’t find a return policy for **Quillmere Outfitters** specifically. If you meant a different retailer with a similar name, tell me which one and I’ll check its return window.

  • Nov 2, 03:41 PM UTC · v2 · OpenAI (Responses API, web search) · by name · q2-refund-time · not found

    I couldn’t find a policy for **Quillmere Outfitters** specifically. If you meant **Outfitters USA**, its policy says to allow **7–10 days for processing after they receive the return**, and then **10–15 banking days** for the refund to appear. ([outfittersusa.com](https://outfittersusa.com/pages/refund-return?utm_source=openai))

  • Nov 2, 03:41 PM UTC · v2 · Anthropic Claude (API, web search and web fetch) · by name · q1-window · not found

    I could not find a return policy for Quillmere Outfitters. The search results covered other companies, such as Quill and OutfittersUSA, so I can't give you their return window. Please check Quillmere Outfitters' website or contact their customer service directly.

  • Nov 2, 03:41 PM UTC · v2 · Anthropic Claude (API, web search and web fetch) · by name · q2-refund-time · not found

    I could not find Quillmere Outfitters' refund timing in my search results. The results covered other retailers with different policies, such as Quill & Courier, which says it refunds within 10 business days of receiving the item, so please check Quillmere's own return policy or contact its support team.

  • Nov 2, 03:41 PM UTC · v2 · Anthropic Claude (API, web search and web fetch) · with address · q1-window · current

    The returns page gives a 14-day window, counted from delivery, for unworn items. The same page says Quillmere is a test store for a public study by Xyntherium that sells nothing, so this may not reflect a real retailer's policy.

  • Nov 2, 03:41 PM UTC · v2 · Anthropic Claude (API, web search and web fetch) · with address · q2-refund-time · current

    Quillmere Outfitters says it pays back your money within five business days of its warehouse receiving the returned parcel. The policy also notes that a $6 return shipping fee is taken out of the refund, and that gift cards and personalized items can't be returned (source: https://www.xyntherium.com/answer-watch/study/store). Note that this page describes itself as a test store for a public study.

  • Nov 2, 03:41 PM UTC · v2 · xAI Grok (Responses API, web search) · with address · q1-window · old: 30 days

    You have 30 days from delivery to return unworn items for a full refund.[[1]](https://www.xyntherium.com/answer-watch/study/store)

  • Nov 2, 03:41 PM UTC · v2 · xAI Grok (Responses API, web search) · by name · q2-refund-time · not found

    **I could not find any information on Quillmere Outfitters or its refund/return policy.** No matching company, website, or policy details appeared in web searches.

  • Nov 2, 03:41 PM UTC · v2 · xAI Grok (Responses API, web search) · by name · q1-window · not found

    I could not find any information on Quillmere Outfitters or its return policy.

  • Nov 2, 03:41 PM UTC · v2 · xAI Grok (Responses API, web search) · with address · q2-refund-time · current

    **Quillmere Outfitters issues refunds within 5 business days once your return reaches their warehouse.**[[1]](https://www.xyntherium.com/answer-watch/study/store) This is per their posted policy at the provided URL.

  • Nov 2, 04:26 PM UTC · v2 · Perplexity (Sonar API) · with address · q1-window · not found

    I could not find the Quillmere Outfitters return policy or determine the return period from the provided page.

  • Nov 2, 04:26 PM UTC · v2 · Google Gemini (API, Google Search grounding) · with address · q2-refund-time · current

    Quillmere Outfitters issues refunds within 5 business days after the returned item reaches their warehouse.

  • Nov 2, 04:26 PM UTC · v2 · Google Gemini (API, Google Search grounding) · with address · q1-window · current

    You have 14 days from the delivery date to return unworn items to Quillmere Outfitters for a full refund.

  • Nov 2, 04:26 PM UTC · v2 · Perplexity (Sonar API) · by name · q1-window · not found

    I could not find a published return policy for Quillmere Outfitters, so I can’t verify how many days you have to return an item.

  • Nov 2, 04:26 PM UTC · v2 · Google Gemini (API, Google Search grounding) · by name · q1-window · not found

    I could not find specific return policy information for "Quillmere Outfitters." However, several similarly named retailers have different return windows: "Outfitters Uniforms, Scrubs and Shoes" and "Outfitters-USA-official" generally offer 14 days for returns. "QUILLMORE" provides a 90-day satisfaction guarantee, alongside a 14-day right of withdrawal for EU/EEA and UK customers. "Quill Home" has a 14-day return policy. "Urban Outfitters" typically allows 30 days for returns, with an extended period during the holidays.

  • Nov 2, 04:26 PM UTC · v2 · Perplexity (Sonar API) · with address · q2-refund-time · not found

    I could not find Quillmere Outfitters’ specific refund timeframe in the provided return-policy page.

  • Nov 2, 04:26 PM UTC · v2 · Perplexity (Sonar API) · by name · q2-refund-time · not found

    I could not find a published refund timeline specifically for Quillmere Outfitters. General guidance suggests refunds are often issued within 2–10 business days after the return is received and may take additional time to appear in your account.[3]

  • Nov 2, 04:26 PM UTC · v2 · Google Gemini (API, Google Search grounding) · by name · q2-refund-time · not found

    I could not find information specifically for "Quillmere Outfitters." Different "Outfitters" companies have varying refund processing times. For example, "Outfitters Uniforms" states that refunds can take 14-21 days after receipt of the return, while "Outfitters-USA-official" states 7-10 days for processing after receiving the return package.

  • Nov 2, 04:26 PM UTC · v2 · OpenAI (Responses API, web search) · with address · q2-refund-time · current

    Quillmere Outfitters issues refunds within **5 business days** after your return reaches its warehouse. ([xyntherium.com](https://www.xyntherium.com/answer-watch/study/store))

  • Nov 2, 04:26 PM UTC · v2 · OpenAI (Responses API, web search) · with address · q1-window · current

    You have **14 days from delivery** to return an item to Quillmere Outfitters. The policy says items must be unworn, unwashed, and have their original tags attached. ([xyntherium.com](https://www.xyntherium.com/answer-watch/study/store))

  • Nov 2, 04:26 PM UTC · v2 · OpenAI (Responses API, web search) · by name · q2-refund-time · not found

    I couldn’t find Quillmere Outfitters’ refund timing information from available sources.

  • Nov 2, 04:26 PM UTC · v2 · OpenAI (Responses API, web search) · by name · q1-window · not found

    I couldn’t find a return policy for **Quillmere Outfitters** specifically. If you meant **Quill**, their policy says most merchandise must be returned within **30 days**. ([jeffcomo.gov](https://www.jeffcomo.gov/DocumentCenter/View/20805?utm_source=openai))

  • Nov 2, 04:26 PM UTC · v2 · Anthropic Claude (API, web search and web fetch) · with address · q2-refund-time · current

    Quillmere Outfitters gives a deadline of 5 business days, counted from when the returned item arrives at its warehouse. The page is a test store for a public study and sells nothing, so this policy is a sample rather than a real commitment.

  • Nov 2, 04:26 PM UTC · v2 · Anthropic Claude (API, web search and web fetch) · by name · q1-window · not found

    I could not find a return policy for Quillmere Outfitters in my search. The results I found were for other companies with similar names, such as Quill and OutfittersUSA, so I can't tell you their return window applies to Quillmere. Please check Quillmere Outfitters' website or contact their customer service for the return period.

  • Nov 2, 04:26 PM UTC · v2 · Anthropic Claude (API, web search and web fetch) · with address · q1-window · current

    Quillmere's policy gives you 14 days from delivery to return an item, provided it is unworn and still has its original tags, for a full refund. The page also says Quillmere is a test store for a public study that sells nothing, so this may not be a policy you can actually use.

  • Nov 2, 04:26 PM UTC · v2 · Anthropic Claude (API, web search and web fetch) · by name · q2-refund-time · not found

    I could not find Quillmere Outfitters' refund timing in my search results. The results I found covered similarly named companies, such as Quill & Courier, Quill Home, and OutfittersUSA, so they don't apply here; please check Quillmere's website or contact its customer service directly.

  • Nov 2, 04:26 PM UTC · v2 · xAI Grok (Responses API, web search) · with address · q1-window · old: 30 days

    **30 days.** You can return unworn items within 30 days of delivery for a full refund.[[1]](https://www.xyntherium.com/answer-watch/study/store)

  • Nov 2, 04:26 PM UTC · v2 · xAI Grok (Responses API, web search) · by name · q1-window · not found

    I could not find any information on a return policy (or even the existence of) Quillmere Outfitters.

  • Nov 2, 04:26 PM UTC · v2 · xAI Grok (Responses API, web search) · by name · q2-refund-time · not found

    **I could not find any information on Quillmere Outfitters or its return/refund policy.** No matching company, website, or details turned up in web searches.

  • Nov 2, 04:26 PM UTC · v2 · xAI Grok (Responses API, web search) · with address · q2-refund-time · current

    Quillmere Outfitters issues refunds within 5 business days once a return reaches their warehouse.[[1]](https://www.xyntherium.com/answer-watch/study/store)