● REC2023-06-22 · Federal court, New York6 cases did not exist

Every one of these was handed over first, and caught by someone else afterwards.

Lawyers, consultants, support staff and engineers have all had AI hand them something that was "almost right". We want to hear about your most recent time: how did you decide it was good to go?

Tell us about that time ↓
TIME / About 7 minutesPRIVACY / No names or companies publishedYOU GET / The summary report
Illustration · AI generated
fig.1 · Already on the record
2,207 Every dot is one AI-fabricated citation in a court record. The ones who caught it were almost always opposing counsel or the judge. AI HALLUCINATION CASES DATABASE · D. CHARLOTIN · AS OF 2026-10-23
fig.2 · Distrust, but not a check every time
Do not fully trust AI output96%
Check before every submission48%
Those 48 points in between: what decides it is good to go? SONAR 2026 · 1,100+ developers · vendor survey
fig.3 · The price once it is found
$100$1K$10K$100K$1M$10M$100M Airline chatbotCA$812 Lawyer's briefUS$5K Consulting refundAU$97K False AI claimsUS$400K Insurer's new systemNT$30M Bank migration£48.65M Fines, damages and refunds, roughly converted to US dollars and placed on one log scale
fig.4 · Four things that really happened
2023-06-22 · Federal court, New YorkA lawyer wrote a brief with AI and filed 6 cases that do not existFined US$5,000
2024-02-14 · CanadaAn airline's support chatbot got the refund rules wrong, and the airline was held liableOrdered to pay CA$812
2025 · STACK OVERFLOW DEVELOPER SURVEY66% have met AI answers that were "almost right, but not quite"31,476 respondents
2019-09 · TaiwanA life insurer replaced its core system, and 152,000 policies went wrongFined NT$30M
The pictures are AI-generated illustrations, not the actual scenes.
STEP 01 · Pick one

Which one was your most recent?

TIMEAbout 7 minutesA few sentences is fine
PRIVACYNot publishedOnly we see names and companies
YOU GETThe summary reportSent to the contact you leave
// 01 · About you
Which of these is closest to your role?Required
> Please pick a role.
How large is your organization?Required
> Please pick a size.
// 02 · The last timeThe last time you had to deal with one of these
Most recently, which of these did you (or your team) need to do? Pick the one that happened most recently.Required
> Please pick one; if you pick "Other", write down what it was.
Roughly when was that?Required
If it is hard to recall, think back from your last report, release, audit or client inquiry.
> Please pick a time.
We want to know about the moment you decided to check. No public survey has asked about this yet.
> This one is required.
The steps of "how you checked" are the part we most want to understand. A few steps, in order, is enough.
> This one is required.
// 03 · What it cost
Roughly how much time did it take?
How many working hours the review takes. A rough figure is fine.
hours, people involved
Did you spend extra money because of it (tools, outsourcing, consultants, overtime)?
US$
> Amounts must be numbers only (no currency), e.g. 500 or 1,200.5.
// 04 · What you tried
If you have not looked, please write "No", and tell us why if you can.
> This one is required.
// 05 · Follow-up
To solve the problem above, how much would your organization be willing to pay per year?Required
For a fixed amount, fill in the same number in both boxes.
Per year US$ to US$
> Please fill in a range, or pick "Would not pay" or "Don't know".
// 06 · Contact
Your details are not published and not passed to third parties.
> Please leave your name.
> Please leave your company name.
> Please fill in an email address or phone number.