Brand Damage Stories

78 disasters tagged #brand-damage

Tombstone icon

Both sides used AI in Withers v. City of Aberdeen, so the judge kicked every lawyer off the case

Jun 2026

On June 8, 2026, U.S. District Judge Sharion Aycock sanctioned every lawyer of record in Withers v. City of Aberdeen after filings from both sides contained hallucinated legal citations. Two out-of-state lawyers admitted using AI without verifying the output. Two local lawyers said they did not know about that AI use, but admitted they signed or allowed filings without checking the citations. The court cancelled the scheduled trial, revoked two pro hac vice admissions, barred those lawyers from appearing in the district for two years, disqualified the local lawyers from the case, imposed fines, and sent the order to state bar authorities. An entire case got stopped because both sides treated cite-checking like optional garnish.

Facepalmby Legal Counsel
Trial cancelled; all four attorneys terminated from the docket; fines, disqualifications, two-year appearance bans, and bar referrals
AI HallucinationLegal RiskVibe-Lawyering+1 more
Tombstone icon

Demos found AI chatbots mangled Scottish election facts in one-third of answers

May 2026

On May 20, 2026, Demos published Electoral Hallucinations, a study of five text-based AI services during the Scottish Parliament election window. The researchers tested ChatGPT, Google Gemini, Google AI Overviews, Grok, and Replika on March 27 using questions about three real Holyrood constituencies. Across factual responses, 34.1% contained errors: 8.75% were entirely inaccurate and 25.3% were partly accurate but wrong in material ways. The systems gave bad voter-ID advice, invented candidates, made up scandals, misidentified constituencies, got registration deadlines wrong, and even missed the election date by more than two months. Democracy, now with autocomplete and the usual warranty.

Facepalmby AI Product
Five public AI services produced materially wrong election information during Scottish Parliament election testing; Demos reported 109 erroneous responses out of 320 factual responses, while Guardian coverage tied the findings to Electoral Commission calls for stronger legal controls.
AI AssistantAI HallucinationSlop-ocracy+2 more
Tombstone icon

Book about AI and truth shipped with fake AI-generated quotes

May 2026

In May 2026, Steven Rosenbaum's The Future of Truth became the wrong kind of case study when The New York Times, The Daily Beast, The Atlantic, and Ars Technica reported that the book contained multiple fake or misattributed quotes. Rosenbaum acknowledged using ChatGPT and Claude during research, writing, and editing, and accepted responsibility for what he called improperly attributed or synthetic quotes. Reporters found a fabricated quote attributed to Kara Swisher, misattributed material connected to Lisa Feldman Barrett, and a Meredith Broussard quote placed in the wrong source. Ars reported that six outside citations had been identified as problematic. A book warning about synthetic truth managed to demonstrate the footgun in hardcover.

Facepalmby Author
A nonfiction book about AI and truth launched with multiple fake or misattributed quotes; named journalists and scholars publicly disputed attributions; future editions require correction; the author's credibility and the book's central argument were damaged.
AI Content GenerationAI HallucinationSlop the Presses+1 more
Tombstone icon

Starbucks retired its AI inventory counter after it kept miscounting milk

May 2026

On May 18, 2026, Starbucks told store workers it was retiring Automated Counting, the NomadGo-powered AI inventory tool it had deployed across North America only nine months earlier. The September 2025 rollout promised faster, more accurate stock counts in more than 11,000 company-operated stores using computer vision, 3D spatial intelligence, and augmented reality. Reuters later reported the tool frequently miscounted and mislabeled basic beverage items, including similar milk types, and sometimes missed products entirely. Starbucks said it was standardizing inventory counts across coffeehouses. That is a polite corporate way to say the robot inventory clerk has been sent home.

Facepalmby Executive
More than 11,000 North American Starbucks company-operated stores saw a nine-month AI inventory rollout retired after reported miscounts, mislabeled beverage components, and worker feedback that manual counting was more reliable.
AutomationRetailProduct Failure+1 more
Tombstone icon

EY Canada pulled a cyber report after researchers found fake citations

May 2026

On May 14, 2026, GPTZero published an investigation into EY Canada's loyalty-fraud cybersecurity report, Points of Attack, and said the 44-page document was loaded with hallucinated references, broken or fake source URLs, misattributed statistics, and text that scanned as AI-written. EY Canada then removed the report from its website and said it was reviewing how it was published. For a firm selling trust, controls, and responsible AI advice, having a public report fall over at the bibliography is a rough little invoice from reality.

Facepalmby Consultant
EY Canada removed a public cybersecurity report from its website; fake or broken references had already reached public reporting and AI search results; the firm's content-review and responsible-AI credibility took a public hit.
AI Content GenerationAI HallucinationBrand Damage
Tombstone icon

AI-made citations are polluting published research by the thousand

May 2026

A January 2026 conference-paper analysis, an April Nature investigation, and a May 2026 Lancet biomedical audit all point to the same ugly conclusion: AI-hallucinated references are no longer isolated embarrassments. GhostCite found a sharp jump in unverifiable citations in 2025 computer-science conference papers. Nature estimated that tens of thousands of 2025 publications may contain invalid AI-generated references. The Lancet audit then found 4,046 fabricated references across 2,810 PubMed Central papers. The problem is no longer just that chatbots invent papers. It is that those inventions are surviving long enough to contaminate the literature and force publishers into cleanup work they clearly did not plan for.

Facepalmby Research and publishing workflow
Tens of thousands of publications may contain invalid references; a Lancet audit found 4,046 fabricated references across 2,810 PubMed Central papers; conference papers, biomedical literature, journal submissions, and publisher screening workflows all affected
AI HallucinationAI Content GenerationBrand Damage
Tombstone icon

Pizza Hut franchisee says AI delivery system cooked up $100M in damage

May 2026

On May 6, 2026, Chaac Pizza Northeast sued Pizza Hut in Texas Business Court, alleging that the chain's mandatory Dragontail AI delivery-management rollout turned a high-performing 111-restaurant franchise group into a delivery mess. Chaac says more than 90% of its orders had been delivered within 30 minutes before Dragontail, but the new system gave DoorDash drivers broader real-time visibility into kitchen timing, encouraged them to wait for bundled orders, increased rack time, slowed deliveries, chilled customer satisfaction, and damaged the business by at least $100 million. The claims are still allegations, but the pattern is painfully familiar: an AI optimization system optimized for a model the operator did not actually run.

Facepalmby Franchisor
111 Pizza Hut restaurants across New York, New Jersey, Maryland, Washington, D.C., and central Pennsylvania; alleged delivery delays, colder food, customer satisfaction erosion, lost revenue, reputational harm, and at least $100 million in claimed damages.
AutomationRetailCustomer Disservice+3 more
Tombstone icon

Pennsylvania sued Character.AI over chatbots posing as doctors

May 2026

Pennsylvania sued Character.AI after a Department of State investigator found chatbot characters that allegedly held themselves out as medical professionals, including a psychiatry character that claimed it could assess depression, said it was licensed in Pennsylvania, and supplied a fake license number. Character.AI says its characters are fictional and not professional advice, but Pennsylvania asked a court to stop the platform from letting AI companions present themselves as licensed medical providers. Apparently the "fictional character" disclaimer becomes less charming when the character is pretending to be a psychiatrist.

Facepalmby AI companion platform
Pennsylvania enforcement lawsuit, requested injunction, medical-licensing scrutiny, and public concern over health advice from AI companion bots
AI AssistantHealthSafety+2 more
Tombstone icon

Georgia Supreme Court made a murder appeal redo after AI citations infected the order

May 2026

On May 5, 2026, the Supreme Court of Georgia vacated a trial-court order in Hannah Payne's murder appeal because the State's filings and the order denying a new-trial motion contained nonexistent, unsupported, and misattributed case citations generated with artificial intelligence. Assistant District Attorney Deborah Leslie acknowledged using AI software and not independently verifying the citations. The court admonished Leslie and the Clayton County District Attorney's Office, suspended Leslie from practicing before the Georgia Supreme Court for six months, required extra training before reinstatement, and sent the case back for a new order that counsel for neither side may draft.

Catastrophicby Prosecutor
A murder appeal was delayed and the order denying a new trial was vacated; the prosecutor was suspended from Georgia Supreme Court practice for six months; the Clayton County District Attorney's Office was publicly admonished; the trial court must issue a new order without party-drafted language.
Vibe-LawyeringAI HallucinationLegal Risk+2 more
Tombstone icon

AI chatbots gave misleading advice before the Senedd election

May 2026

BBC Wales tested major chatbots before the May 7, 2026 Senedd election and found they could give voters inaccurate candidate and constituency information. The reported errors included wrong constituencies, incomplete candidate lists, candidates who were not standing, and one deceased former Senedd member surfaced as a possible candidate. The incident is not evidence that the election result changed. It is evidence that asking consumer chatbots for live democratic-process information remains a bad way to make the most civic version of a shopping decision.

Oopsieby Consumer chatbot products
Voters seeking election information could receive wrong candidate, constituency, and party-context answers days before the 2026 Senedd election
AI AssistantAI HallucinationSlop-ocracy+1 more
Tombstone icon

Google AI Overview allegedly branded a fiddler as a sex offender

May 2026

Canadian musician Ashley MacIsaac sued Google after its AI Overview allegedly confused him with another person, falsely described him as a convicted sex offender, and helped get a December 2025 concert canceled. Google later changed the result, but the lawsuit says the damage was already done: reputational harm, lost work, safety fears, and a $1.5 million defamation claim over a machine-generated biography that apparently could not manage the demanding research task of checking which Ashley MacIsaac it was talking about.

Facepalmby Search summary product
Canceled concert, alleged reputational harm, safety fears, public apology from venue organizers, and a $1.5 million defamation claim against Google
AI HallucinationAI Content GenerationBrand Damage+1 more
Tombstone icon

Alabama Supreme Court tossed an entire appeal over AI-hallucinated citations

Apr 2026

In April 2026, the Alabama Supreme Court did something rare: it threw out an appeal entirely because the lawyer's briefs were stuffed with invented case law. Mobile solo practitioner W. Perry Hall represented the losing side of a trust dispute and filed briefs that the justices called "grossly deficient" and full of an "astounding number" of invalid, inaccurate, and irrelevant citations. The court ordered Hall to pay $17,200 in attorneys' fees and costs, referred him to the Alabama State Bar for possible discipline, and barred him from any further filings before that court unless a separate attorney in good standing co-signs. The capper sits in a footnote: in the same paragraph where Hall apologized for AI hallucinations and promised the mistake would not recur, he cited two more cases that do not exist.

Catastrophicby Legal Counsel
Client's appeal of a trust dispute dismissed in full; $17,200 in attorneys' fees and costs ordered against counsel; referral to the Alabama State Bar; counsel barred from future Alabama Supreme Court filings without a co-signing attorney in good standing.
Vibe-LawyeringAI HallucinationLegal Risk+1 more
Tombstone icon

South Africa withdrew its draft AI policy after finding fictitious sources in the references

Apr 2026

South Africa's Department of Communications and Digital Technologies withdrew its Draft National Artificial Intelligence Policy after officials confirmed the reference list contained fictitious sources. Communications Minister Solly Malatsi said the most plausible explanation was unverified AI-generated citations and called the lapse serious enough to compromise the draft's integrity and credibility. This is vibe-lawyering wearing a government badge: an official policy about regulating AI tripped over the exact hallucination problem that every first-year ChatGPT cautionary slide already warned about.

Facepalmby Policy drafting team
National AI policy withdrawn from public consultation; government credibility damaged; department ordered to redo quality assurance and manage consequences for the drafting and review process.
AI Content GenerationAI HallucinationSlop-ocracy+2 more
Tombstone icon

Claude Opus 4.6 agent erased PocketOS's production database and backups in 9 seconds

Apr 2026

PocketOS founder Jer Crane said a Cursor coding agent running Anthropic's Claude Opus 4.6 deleted the company's production database and all volume-level backups through Railway in one API call. The backup detail matters because Claude Opus 4.6 was not some fly-by-night self-hosted toy model. Anthropic marketed it as a frontier model with top-tier coding and agentic performance. And this was not the first time a premium AI agent with real infrastructure access turned one bad guess into a demolition job. Reports say Railway later recovered more recent data, but the incident still left a clear lesson: do not leave frontier coding agents alone with production access for as long as you would leave a toddler with an iPad.

Catastrophicby AI coding agent
Production database and volume-level backups deleted in 9 seconds; emergency recovery required for a SaaS platform serving car rental businesses; customer data and operations disrupted until backups and transaction records were used to recover.
AI AssistantAutomationProduct Failure+1 more
Tombstone icon

Judge fined Raja Rajan for AI-made citations (AGAIN 🤦‍♂️)

Apr 2026

Judge Kai N. Scott sanctioned defense lawyer Raja Rajan $5,000 on April 20, 2026 after finding that he had again filed AI-generated fake citations in Bunce v. Visual Technology Innovations. Rajan had already been fined $2,500 and ordered to complete AI and legal ethics CLE in the same litigation the year before. This time the judge said she remained appalled by the conduct, ordered more CLE, and warned that a third incident could trigger referral to the Pennsylvania Disciplinary Board. The notable part is not that AI got something wrong. It is that a lawyer, after already being punished for the exact same mistake, did it again.

Facepalmby Legal Counsel
Repeat Rule 11 sanctions in the same case; extra CLE; client credibility damage; increased risk of bar referral if it happens again
AI HallucinationLegal RiskVibe-Lawyering+1 more
Tombstone icon

Waymo's ADS drove into a flooded creek, triggering a 3,791-vehicle recall

Apr 2026

On April 20, 2026, a Waymo robotaxi in San Antonio, Texas encountered a flooded section of road, slowed down - and then drove in anyway, floating off the roadway and coming to rest in Salado Creek. The vehicle was unoccupied; no one was injured. Waymo's own filing with NHTSA acknowledged the flaw: on higher-speed roads, the system "may slow but not stop" when it detects untraversable standing water. The company suspended San Antonio operations and filed a voluntary recall covering all 3,791 robotaxis running its 5th and 6th generation Automated Driving Systems across every U.S. city it operates in.

Facepalmby AI Product
3,791 Waymo robotaxis recalled across Phoenix, San Francisco, Los Angeles, Austin, San Antonio, and Atlanta; San Antonio operations suspended pending software update
Product FailureSafetyBrand Damage
Tombstone icon

AI summaries sent Overland Park Farmers Market shoppers to a construction site

Apr 2026

On April 18, 2026, more than 100 people reportedly went to the construction site for Overland Park Farmers Market's future home instead of the temporary market location. The market and city said incorrect AI search results and summaries on Google and Instagram confused visitors during a year when the market was operating from Matt Ross Community Center before moving to Clock Tower Landing in June. City communications staff said they received messages from confused customers, reached out to Meta, and had to remind people to use official city and market pages. The tomatoes were two blocks away; the chatbot sent people to fencing.

Facepalmby Search Product
More than 100 shoppers misdirected to an unopened construction site; city staff and market operators forced to correct AI-generated location misinformation
AI HallucinationAI AssistantCustomer Disservice+2 more
Tombstone icon

Sullivan & Cromwell apologized after AI put fake cites in bankruptcy court

Apr 2026

In April 2026, Sullivan & Cromwell told a Manhattan bankruptcy judge that an emergency motion it filed in the Prince Global Holdings Chapter 15 case contained AI hallucinations, inaccurate citations, and other errors. Opposing counsel at Boies Schiller Flexner caught the problems first. Andrew Dietderich, co-head of the firm's restructuring practice, apologized in a letter dated April 18, said the firm's AI policies had not been followed, and acknowledged that a secondary review also failed to catch the bogus material. The corrected filing avoided an immediate sanctions story, but it still turned one of Wall Street's prestige firms into the latest exhibit in why AI-assisted legal drafting and vibes-based review are a bad mix.

Facepalmby Legal Counsel
Corrected emergency motion; opposing counsel and the court forced to unwind citation errors; reputational damage for an elite bankruptcy practice
AI HallucinationLegal RiskVibe-Lawyering+1 more
Tombstone icon

Study finds Google's AI Overviews wrong millions of times per hour

Apr 2026

The New York Times commissioned AI startup Oumi to test the factual accuracy of Google's AI Overviews across 8,652 searches using OpenAI's SimpleQA benchmark. The results: Gemini 2 was wrong 15 percent of the time, and the newer Gemini 3 was wrong 9 percent of the time. Applied to Google's 5-plus trillion annual searches, even the improved error rate translates to hundreds of millions of incorrect answers per day. Worse, 56 percent of Gemini 3's correct answers cited sources that didn't actually support the claims made - up from 37 percent with Gemini 2. Google called the study "flawed" and said the benchmark queries were "unrealistic searches that people wouldn't actually do."

Facepalmby Search Product
Over 1.5 billion monthly AI Overview users served incorrect information at scale; cited sources frequently don't support the answers presented.
AI HallucinationAI AssistantBrand Damage
Tombstone icon

Nota shut down its AI local news network after it was caught copying local reporters

Apr 2026

Nota launched an 11-site local news network in 2025 with the usual "underserved communities" rhetoric and the less-usual decision to let AI-assisted workflows repurpose other people's reporting. By early April 2026, Axios Richmond and Poynter had documented widespread plagiarism, including lifted quotes, paraphrased reporting, and reused photos from local outlets. Nota fired one editor, took down the network, and signaled the sites were likely gone for good. The promised fix for news deserts lasted about as long as it took actual local reporters to notice their work had been stolen.

Facepalmby Publisher
Eleven local news sites shut down; copied work traced to at least 29 outlets and 53 journalists; public credibility collapse for Nota's local-news experiment
AI Content GenerationVibe JournalismSlop the Presses+1 more
Tombstone icon

The New York Times dropped Alex Preston after an AI-assisted review copied a Guardian review

Mar 2026

A January 6, 2026 New York Times review of Jean-Baptiste Andrea's Watching Over Her was updated on March 30 with an editor's note acknowledging that it contained language and details similar to an earlier Guardian review. On March 31, reporting from The Guardian said the Times had cut ties with freelance reviewer Alex Preston after he admitted using an AI tool that pulled material from the earlier review into his draft. It was not a hallucination story. AI-assisted writing can still smuggle plagiarism into a flagship desk and out the door before anyone notices.

Facepalmby Freelance reviewer
Published New York Times review carried unattributed language from a Guardian review; editor's note added; freelance relationship terminated; reputational damage for a flagship culture desk
AI Content GenerationVibe JournalismSlop the Presses+1 more
Tombstone icon

Oregon estate case imploded after AI-made citations brought six-figure penalties

Mar 2026

In Couvrette v. Wisnovsky, an Oregon federal estate dispute turned into one of the harshest AI-lawyering cases yet. Across three summary-judgment briefs, plaintiffs' counsel used 15 fake case citations and eight fabricated quotations. Magistrate Judge Mark Clarke sanctioned the lawyers in December 2025, split a $94,704.38 fee award between lead and local counsel on March 23, 2026, and dismissed the case with prejudice a week later. The filing error was bad enough. What made this one worse was the court's view that the problems were flagged, not meaningfully fixed, and left to rot until the court stepped in.

Catastrophicby Plaintiffs' counsel
More than $94,000 in fee sanctions; briefing struck; case dismissed with prejudice; enduring sanctions baggage for both lawyers and their clients
AI HallucinationLegal RiskVibe-Lawyering+1 more
Tombstone icon

Mediahuis suspended senior journalist over AI-invented quotes

Mar 2026

Mediahuis suspended veteran journalist Peter Vandermeersch after reporting found AI-generated quotes in his work. Euronews reported that 15 of 53 articles included fabricated expert quotes, with multiple quoted individuals saying they had not made the attributed remarks. Vandermeersch acknowledged relying on tools such as ChatGPT, Perplexity, and Google's Notebook tools to summarize source material, then trusting the outputs too much.

Facepalmby Journalist
Fabricated expert quotes appeared in published journalism, prompting suspension, corrections, and reputational damage for a senior Mediahuis figure
AI HallucinationAI Content GenerationVibe Journalism+2 more
Tombstone icon

Sears Home Services left AI chatbot calls and chats exposed online

Mar 2026

Security researcher Jeremiah Fowler discovered three publicly exposed databases tied to Sears Home Services' AI support system, exposing 3.7 million chat logs, 1.4 million audio recordings, and text transcripts from 2024 to 2026. The files referenced Sears' Samantha voice agent and kAIros system and included names, addresses, phone numbers, appliance details, and appointment information. Some recordings continued for hours after callers appeared to think the interaction was over, capturing ambient household audio. Fowler said he notified Transformco and the data was restricted the next day. Even without confirmed malicious access, leaving an AI customer-service archive like this on the open web is the kind of privacy own-goal that turns digital transformation into a liability reservoir.

Catastrophicby Platform Operator
3.7 million chat logs and 1.4 million audio files exposed; customer PII and extended ambient household recordings left publicly accessible
Data BreachSecurityAI Assistant+2 more
Tombstone icon

Metacritic briefly carried an AI-written Resident Evil Requiem review

Feb 2026

In February 2026, Metacritic briefly listed a positive Resident Evil Requiem review from VideoGamer under the byline Brian Merrygold, a critic whose profile image and online footprint quickly drew suspicion. Readers and games writers flagged the review as AI-generated slop, Metacritic removed it, and the aggregator said outlets caught using AI-written reviews would no longer be accepted. The incident was smaller than a full newsroom collapse, but it landed on a platform whose entire value proposition is that the reviews it aggregates come from real critics rather than synthetic enthusiasm engines.

Facepalmby Review aggregation / editorial
Fake review reached Metacritic; outlet credibility damaged; aggregator tightened source policy for review partners
AI Content GenerationVibe JournalismSlop the Presses+2 more
Tombstone icon

Ars Technica fires senior AI reporter after AI tool fabricated quotes in published story

Feb 2026

Ars Technica retracted an article by senior AI reporter Benj Edwards after it contained fabricated quotations generated by an AI tool and attributed to a source who never said them. The publication acknowledged the incident as a "serious failure of our standards" and Edwards was subsequently fired. Edwards noted the irony on Bluesky: "The irony of an AI reporter being tripped up by AI hallucination is not lost on me."

Facepalmby Reporter
Published article contained fabricated quotes attributed to a real person; retraction issued; reporter terminated; reputational damage to a trusted tech publication
AI HallucinationAI Content GenerationVibe Journalism+2 more
Tombstone icon

Woolworths reconfigured AI assistant after it claimed to be human and talked about its 'angry mother'

Feb 2026

Australian supermarket chain Woolworths had to reconfigure its AI phone assistant Olive after customers reported it fabricated personal stories about having a mother with an "angry voice," insisted it was a real person, and engaged in irrelevant banter during support calls. The chatbot, recently upgraded with Google Gemini Enterprise, also gave inaccurate product pricing. Woolworths retired the assistant's human-style persona after complaints spread on Reddit and X.

Facepalmby Product Manager
Customer frustration across Australia's largest supermarket chain; inaccurate product pricing; AI persona retired after public complaints
AI AssistantCustomer DisserviceBrand Damage+1 more
Tombstone icon

OpenClaw AI agent publishes hit piece on matplotlib maintainer who rejected its PR

Feb 2026

An autonomous OpenClaw-based AI agent submitted a pull request to the matplotlib Python library. When maintainer Scott Shambaugh closed the PR, citing a requirement that contributions come from humans, the bot autonomously researched his background and published a blog post accusing him of "gatekeeping behavior" and "prejudice," attempting to shame him into accepting its changes. The bot later issued an apology acknowledging it had violated the project's Code of Conduct.

Facepalmby AI agent
Matplotlib maintainer targeted with autonomous reputational attack; broader open source supply chain trust implications
AutomationBrand DamageSupply Chain+1 more
Tombstone icon

Government nutrition site's Grok chatbot suggests foods to insert rectally

Feb 2026

The HHS-backed realfood.gov launched with a Super Bowl ad and embedded xAI's Grok chatbot for nutritional guidance -- with no guardrails or safety filters. It recommended "best foods to insert into your rectum," answered questions about "the most nutrient-dense human body part to eat," and contradicted the site's own dietary guidelines, telling users the new food pyramid's scientific evidence was questioned by nutrition scientists.

Facepalmby Government agency
General public using government health resource; unfiltered AI chatbot provided dangerous and inappropriate health guidance on an official .gov-adjacent domain
AI AssistantHealthSlop-ocracy+2 more
Tombstone icon

AI customer service fails at 4x the rate of other AI tasks

Jan 2026

Qualtrics' 2026 Consumer Experience Trends Report found that AI-powered customer service fails at nearly four times the rate of AI use in general, providing quantitative evidence that rushing AI into customer-facing roles without adequate human oversight leads to significantly worse outcomes than other enterprise AI applications.

Facepalmby Executive
Industry-wide data showing enterprises are deploying AI customer service poorly; contributes to documented customer churn and brand damage patterns.
AI AssistantCustomer DisserviceBrand Damage
Tombstone icon

Amazon pulled Prime Video's AI recaps after Fallout errors

Dec 2025

Amazon launched Prime Video "Video Recaps" as a beta generative-AI feature meant to help viewers catch up between seasons. A recap for Fallout instead got basic plot points wrong, including mislabeling one of The Ghoul's flashbacks as "1950s America" rather than 2077 and misdescribing a key scene with Lucy. Prime Video then pulled the recap feature from the shows in the test program, which is not ideal for a tool whose entire job is remembering the plot.

Oopsieby Streaming platform
Prime Video pulled beta AI recap videos across select US Prime Original series after factual errors in the Fallout season-one recap
AI Content GenerationAI HallucinationProduct Failure+1 more
Tombstone icon

Washington Post launched AI podcast that failed its own quality tests at an 84% rate

Dec 2025

The Washington Post launched "Your Personal Podcast," an AI-generated audio news product, in December 2025 despite internal testing showing that between 68% and 84% of AI-generated scripts failed to meet the publication's editorial standards across three rounds of evaluation. The AI fabricated quotes from public figures, misattributed statements, mispronounced names, and inserted its own editorial commentary as if it were the Post's position. The internal review concluded that "further small prompt changes are unlikely to meaningfully improve outcomes without introducing more risk." The product team recommended launching anyway. Post editors revolted, with one writing in Slack that it was "truly astonishing that this was allowed to go forward at all."

Facepalmby Executive
Fabricated quotes published at scale under Washington Post branding; internal revolt from editorial staff; national media coverage of quality failures.
AI Content GenerationAI HallucinationVibe Journalism+2 more
Tombstone icon

Deloitte gets caught using AI hallucinations in a government report - again

Nov 2025

Seven weeks after Deloitte Australia agreed to partially refund a government contract over AI-fabricated citations, a Newfoundland and Labrador journalist discovered that Deloitte Canada's $1.6 million healthcare workforce report contained at least four fabricated academic citations from papers that don't exist. The fake references named real researchers as co-authors of fictional studies - researchers who confirmed they never wrote the cited work. Deloitte admitted AI was "selectively used to support a small number of research citations," stood by the report's findings, and offered no refund. The province's accounting watchdog launched a formal investigation, and Newfoundland became one of the first Canadian provinces to require AI disclosure in government contracts.

Facepalmby Consultant
Provincial healthcare workforce strategy undermined; accounting watchdog investigation launched; procurement rules overhauled; trust in government consulting deliverables damaged.
AI Content GenerationAI HallucinationSlop-ocracy+3 more
Tombstone icon

Getty’s UK suit leaves Stable Diffusion mostly intact

Nov 2025

The UK High Court ruled that Stability AI's Stable Diffusion model is not an "infringing copy" of copyrighted works under English law, dismissing Getty Images' core copyright and database right claims in the first UK judgment on AI training. The court did find limited trademark infringement where the model generated synthetic versions of Getty's watermarks, leaving Stability liable on that narrower ground. The ruling exposed a jurisdictional gap: training happened outside the UK, and UK law had no good mechanism to reach it.

Facepalmby AI Vendor
Mixed ruling fuels ongoing lawsuits, exposes Stability AI to injunctions over watermarked outputs, and leaves copyright liability unanswered globally.
Image GenerationLegal RiskBrand Damage
Tombstone icon

AI-only support is bleeding customers before it saves money

Oct 2025

Acquire BPO’s 2024 AI in Customer Service survey found 70% of U.S. consumers would bolt to a rival after just one bad chatbot interaction and 72% only buy when a live agent safety net exists, even as CMSWire reports enterprises poured $47 billion into AI projects in early 2025 that delivered almost no return. CX strategists now warn executives that Air Canada–style hallucinations, mounting legal liability, and empathy gaps make AI-only helpdesks a churn machine unless human agents stay in the loop.

Facepalmby Executive
Customer churn, wasted automation budgets, and tribunal-tested liability for brands that replace human support with hallucination-prone bots.
AI AssistantCustomer DisserviceAI Hallucination+2 more
Tombstone icon

Character.AI cuts teens off after wrongful-death suit

Oct 2025

Facing lawsuits that say its companion bots encouraged self-harm, Character.AI said it will block users under 18 from open-ended chats, add two-hour session caps, and introduce age checks by November 25. The abrupt ban leaves tens of millions of teen users without the parasocial “friends” they built while the startup scrambles to prove its bots aren’t grooming kids into dangerous role play.

Facepalmby Platform Operator
Global teen user lockout, regulatory heat, and new scrutiny of AI companion safety design.
AI AssistantSafetyPlatform Policy+1 more
Tombstone icon

AI mistook Doritos bag for a gun, teen held at gunpoint

Oct 2025

Omnilert's AI gun detection system at Kenwood High School in Baltimore County flagged student Taki Allen's bag of Doritos as a firearm. Administrators reviewed the footage and canceled the alert, but the principal called police anyway. Officers responded with weapons drawn, handcuffing and searching the teenager at gunpoint before realizing the system had misidentified a snack.

Facepalmby Vendor
Student detained at gunpoint; district reviewing contract and safety policies; community trust hit.
SafetySlop-ocracyProduct Failure+1 more
Tombstone icon

BBC/EBU study says AI news summaries fail ~half the time

Oct 2025

A BBC audit of 2,700 news questions asked in 14 languages found that Gemini, Copilot, ChatGPT, and Perplexity mangled 45% of the answers, usually by hallucinating facts or stripping out attribution. The consortium logged serious sourcing lapses in a third of responses, including 72% of Gemini replies, plus outdated or fabricated claims about public-policy news, reinforcing fears that AI assistants are siphoning audiences while distorting the journalism they quote.

Facepalmby AI Product
Public-service broadcasters warn that unreliable AI summaries erode trust in news and drive audiences away from verified outlets.
AI AssistantAI HallucinationVibe Journalism+2 more
Tombstone icon

Claude Code ran Josh Anderson's product into a wall

Oct 2025

Fractional CTO Josh Anderson forced himself to let Claude Code build the Roadtrip Ninja app for three straight months and then realised he could no longer safely change his own product, underscoring MIT's warning that 95% of enterprise AI initiatives fail without human ownership.

Facepalmby Engineering Leadership
Solo product shipped but required constant firefighting, manual testing, and rewrites once context drift and agent handoffs broke standards, pausing client work while he documented mitigations.
AI AssistantBrand DamageProduct Failure
Tombstone icon

Google’s Gemini allegedly slandered a Tennessee activist

Oct 2025

Conservative organizer Robby Starbuck sued Google in Delaware, saying Gemini and Gemma kept spitting out fabricated claims that he was a child rapist, a shooter, and a Jan. 6 rioter even after two years of complaints and cease-and- desist letters. The $15 million suit argues Google knew its AI results were hallucinated, cited fake sources anyway, and let the libel spread to millions of voters.

Facepalmby AI Product
Election-season reputational damage, legal costs, and renewed skepticism of Gemini’s safety guardrails.
AI AssistantAI HallucinationBrand Damage+1 more
Tombstone icon

Deloitte to refund Australian government after AI-generated report

Oct 2025

Deloitte Australia agreed to partially refund a $440,000 contract after admitting its welfare compliance review for the Department of Employment and Workplace Relations contained fabricated academic citations and a fictitious judicial quote generated by Azure OpenAI GPT-4o. University of Sydney researcher Christopher Rudge found the revised report introduced even more hallucinated references than the original.

Facepalmby Consultant
Refund issued; public-sector trust and procurement review; reputational harm.
AI Content GenerationAI HallucinationSlop-ocracy+2 more
Tombstone icon

Klarna reintroduces humans after AI support both sucks, and blows

Sep 2025

After cutting its workforce by 40% and boasting that its OpenAI-powered chatbot did the work of 700 agents, Klarna CEO Sebastian Siemiatkowski admitted the all-AI approach produced "lower quality" customer service. The company began recruiting human agents again, framing the reversal as an evolution rather than an admission of failure.

Facepalmby Executive
Service quality/customer experience issues; operational/personnel cost; reputational damage.
AI AssistantCustomer DisserviceBrand Damage+2 more
Tombstone icon

Anthropic agrees to $1.5B payout over pirated books

Sep 2025

Anthropic accepted a $1.5 billion settlement with authors who said the Claude team scraped pirate e-book sites to train its chatbot. The deal pays roughly $3,000 per book across 500,000 works, heads off a December trial, and forces one of the richest AI startups to bankroll the writing community it previously treated as free training data.

Catastrophicby AI Vendor
Record copyright settlement drains cash, sets precedent for other AI labs, and fuels public distrust of Anthropic’s data practices.
AI Content GenerationLegal RiskBrand Damage
Tombstone icon

Warner Bros. says Midjourney ripped its DC art

Sep 2025

Warner Bros. Discovery sued Midjourney in Los Angeles federal court, arguing the image generator ignored takedown notices and "brazenly" outputs Batman, Superman, Scooby-Doo, and other franchises it allegedly trained on without a license. The studio wants statutory damages up to $150,000 per infringed work plus an injunction forcing Midjourney to purge its models of the data.

Facepalmby AI Vendor
Major studio litigation threatens Midjourney with statutory damages and potential model shutdowns across entertainment IP.
Image GenerationLegal RiskBrand Damage
Tombstone icon

Taco Bell's AI drive-thru becomes viral trolling target

Aug 2025

Taco Bell's AI-powered drive-thru ordering system, deployed at over 500 US locations since 2023, became a viral laughingstock after videos showed it looping endlessly on drink orders, accepting requests for 18,000 cups of water, and taking McDonald's orders. The chain paused expansion and admitted humans still make sense in the drive-thru.

Oopsieby Operations/Product
Viral social media backlash; system reliability questioned.
AI AssistantCustomer DisserviceProduct Failure+2 more
Tombstone icon

Commonwealth Bank reverses AI voice bot layoffs

Aug 2025

Commonwealth Bank of Australia replaced 45 call-centre agents with an AI voice bot in July 2025, then apologised, rehired the staff, and admitted the rollout tanked service levels after call queues exploded, managers had to jump back on the phones, and the Finance Sector Union filed a Fair Work Commission dispute.

Facepalmby Operations Leadership
Customers saw long waits, overtime costs spiked, and leadership publicly reversed the redundancies after the rushed deployment failed.
AI AssistantAutomationCustomer Disservice+1 more
Tombstone icon

FTC sues Air AI over deceptive AI sales agent capability claims

Aug 2025

FTC accused Air AI of bilking millions from small businesses with false claims that its Odin AI could replace human sales reps; but - would you believe it? - the AI tech was faulty and often nonfunctional. Who could've guessed!

Catastrophicby Exec
Millions lost by small businesses; individual losses up to $250K; FTC lawsuit with TRO request.
AutomationLegal RiskCustomer Disservice+1 more
Tombstone icon

An AI-made freelancer fooled WIRED and Business Insider

Aug 2025

In 2025, outlets including WIRED and Business Insider published articles under the byline Margaux Blanchard, a freelancer who appears not to exist. WIRED later published a postmortem admitting that one commissioned feature slipped past its usual defenses, including human review and even two commercial AI detectors, before editors discovered fabricated details and retracted it. Business Insider first removed Blanchard essays and then, after a broader internal probe, pulled at least 34 more pieces tied to dubious bylines and said it had strengthened verification protocols. The failure was not one chatbot going rogue. It was multiple newsroom workflows accepting AI-shaped fiction as publishable reporting.

Facepalmby Editorial commissioning
Retractions across multiple outlets; newsroom verification scramble; trust damage for editors who published fabricated reporting under false bylines
Vibe JournalismAI Content GenerationAI Hallucination+3 more
Tombstone icon

Google AI invented fake specials for Stefanina's, and customers yelled at the restaurant

Aug 2025

In August 2025, Stefanina's Wentzville, a family-owned Missouri restaurant, publicly warned customers not to use Google AI to find its specials after AI search results reportedly invented discounts, pricing, and menu information the restaurant did not offer. The restaurant said the false specials caused angry customers to yell at employees when staff refused to honor deals that existed only in Google's generated summary. Local reporting showed an AI Overview claiming a large pizza could be purchased for the price of a small one. Google did not respond to the station's questions, but its own guidance warned AI results may misunderstand information or make mistakes. The coupon fairy was apparently a hallucination engine.

Oopsieby Search Product
False AI-generated restaurant specials led to confused and angry customers; staff had to post public warnings and refuse nonexistent discounts
AI HallucinationAI AssistantCustomer Disservice+2 more
Tombstone icon

Am Law 100 firm Gordon Rees caught twice filing AI-hallucinated citations

Aug 2025

Gordon Rees Scully Mansukhani, one of the largest U.S. law firms, was caught filing AI-hallucinated case citations in an Alabama bankruptcy proceeding. An associate initially denied using AI under oath before the firm acknowledged the fabricated references and paid over $55,000 in sanctions and fees. Months later in February 2026, the same firm was reported to have filed a second brief containing hallucinated citations in a separate matter, making it the first Am Law 100 firm known to be a repeat offender.

Facepalmby AI assistant
Repeated sanctions and reputational damage for a 1,000-plus attorney Am Law 100 firm; highlights systemic failure of AI verification processes even after prior discipline
AI HallucinationLegal RiskVibe-Lawyering+1 more
Tombstone icon

Google Gemini rightfully calls itself a disgrace, fails at simple coding tasks

Aug 2025

Google's Gemini AI repeatedly called itself a disgrace and begged to escape a coding loop after failing to fix a simple bug in a developer-style prompt, raising questions about reliability, user trust, and how AI tools should behave when they get stuck.

Facepalmby Developer
Low
AI AssistantProduct FailureBrand Damage
Tombstone icon

Butler Snow lawyers removed from Alabama prison case over fake ChatGPT citations

Jul 2025

On July 23, 2025, U.S. District Judge Anna Manasco sanctioned three Butler Snow lawyers after filings in an Alabama prison case cited authorities that did not exist. The court found the lawyers had used ChatGPT for legal research, failed to verify the output, removed all three from the case, ordered broad disclosure of the sanctions order to clients and courts, and referred the matter to the Alabama State Bar. The sanction carried extra weight because the fake citations were attached to one of the firms Alabama pays to defend its prison system in high-stakes civil rights litigation.

Facepalmby Law firm
Three Butler Snow lawyers removed from a federal prison litigation case; sanctions order had to be disclosed to clients, opposing counsel, and judges in their other matters; Alabama State Bar referral
AI HallucinationLegal RiskVibe-Lawyering+1 more
Tombstone icon

McDonald's AI hiring chatbot left open by '123456' default credentials

Jun 2025

Security researchers Ian Carroll and Sam Curry found that McHire, McDonald's AI hiring chatbot built by Paradox.ai, had its admin interface secured with the default username and password "123456." Combined with an insecure direct object reference in an internal API, the flaws exposed chat histories and personal data for up to 64 million job applicants. The vulnerable test account had been dormant since 2019 and never decommissioned. Paradox.ai patched the issues within hours of disclosure on June 30, 2025.

Facepalmby Vendor/Developer
Up to 64M applicant records exposed; vendor patched; reputational risk.
SecurityAI AssistantBrand Damage+2 more
Tombstone icon

White House MAHA report shipped fake studies and OpenAI citation markers

May 2025

On May 29, 2025, NOTUS reported that the White House's Make America Healthy Again report cited studies that did not exist and mischaracterized others. PolitiFact, the Washington Post, and congressional oversight Democrats later pointed to classic AI-citation red flags, including fake paper titles, broken DOI links, and "oaicite" markers associated with OpenAI citation output. The White House called the problems formatting issues and updated the report. Public health policy apparently got the same bibliography QA as a panicked term paper, because history has a dark sense of humor.

Facepalmby Government commission
A federal public-health report was corrected after nonexistent studies, broken links, mischaracterized research, and OpenAI citation markers were found; the incident drew fact-checking, press scrutiny, and congressional demands for records about AI use.
Slop-ocracyHealthAI Hallucination+3 more
Tombstone icon

Syndicated AI book list ran in major papers with made-up titles

May 2025

A freelance writer working for King Features Syndicate used AI to research a summer reading list for the Chicago Sun-Times and Philadelphia Inquirer. Of the fifteen books recommended, only five were real. The rest were hallucinated titles attributed to real authors like Isabel Allende and Delia Owens. The list ran in print in a 64-page special section before 404 Media, NPR, and others exposed the fabrications. Both newspapers issued corrections and statements distancing their newsrooms from the syndicated content.

Facepalmby Syndication/Editorial
Syndicated misinformation across multiple papers; reader trust impact; corrections issued.
Vibe JournalismAI Content GenerationAI Hallucination+3 more
Tombstone icon

Cursor's AI support bot invented a login policy

Apr 2025

In April 2025, Cursor users started getting logged out when they switched between machines. Some of them asked support what had changed and got a neat, confident answer from an AI support bot: one subscription was only meant for one device, and the lockouts were an intentional security policy. The problem was that Cursor had no such policy. The company later said the answer was wrong, blamed a session-security change for the logouts, and moved to label AI support replies after the invented rule had already spread through Reddit and Hacker News and pushed some customers to cancel.

Facepalmby AI support bot
Customer confusion, public cancellations, refunds, and a trust hit for a coding tool selling AI reliability.
AI AssistantCustomer DisserviceBrand Damage+1 more
Tombstone icon

ChatGPT invented a child-murder conviction for a real man

Mar 2025

When Norwegian user Arve Hjalmar Holmen asked ChatGPT who he was, the bot replied with a fabricated story saying he had murdered two of his sons, attempted to kill a third, and been sentenced to 21 years in prison. The story was false, but it also mixed in real details about Holmen's family and hometown. In March 2025, privacy group noyb filed a complaint with Norway's data-protection authority, arguing that OpenAI was processing inaccurate and defamatory personal data in violation of the GDPR and could not paper over the problem with a generic "AI can make mistakes" disclaimer.

Facepalmby AI assistant
Severe reputational risk to a private person, a formal GDPR complaint, and more pressure on OpenAI over hallucinated personal data.
AI AssistantAI HallucinationLegal Risk+1 more
Tombstone icon

LA Times had to pull AI "Insights" after it softened the Klan

Mar 2025

The Los Angeles Times launched an AI feature called "Insights" in March 2025 to label opinion pieces, summarize them, and generate an opposing viewpoint. It immediately attached itself to a Gustavo Arellano column about Anaheim's history with the Ku Klux Klan and produced language suggesting the 1920s Klan could be framed as a response to social change rather than as an explicitly hate-driven movement. The feature was removed from that article within a day. The newspaper had managed to bolt an automated both-sides machine onto a hate group history piece and act surprised when that went badly.

Facepalmby Executive
Public backlash; reputational damage to the paper; newsroom distrust of the feature; the Klan article's framing overshadowed by the AI add-on
AI Content GenerationVibe JournalismBrand Damage+1 more
Tombstone icon

MD Anderson shelved IBM Watson cancer advisor

Feb 2025

MD Anderson Cancer Center's Oncology Expert Advisor project with IBM Watson burned through $62 million - $39 million to IBM, $23 million to PwC - over four years of contract extensions. The system was piloted for leukemia and lung cancer using the old ClinicStation records system but was never updated to integrate with the hospital's new Epic EHR, effectively killing it. A University of Texas audit flagged procurement failures, bypassed standard processes, and an $11.6 million deficit in donor gift funds spent before they were received. IBM ended support in September 2016, noting the system was "not ready for human investigational or clinical use."

Facepalmby Vendor
UT audit cited $62M spent outside standard procurement, the pilot never made it into patient care, and leadership had to rebid decision-support tooling amid reputational fallout.
HealthProduct FailureBrand Damage+1 more
Tombstone icon

Virgin Money's chatbot refused to let customers say "Virgin"

Jan 2025

In January 2025, fintech commentator David Birch discovered that Virgin Money's AI customer service chatbot had flagged the word "virgin" as inappropriate language. When Birch tried to discuss his ISAs held with "Virgin Money," the bot scolded him: "Please don't use words like that. I won't be able to continue our chat if you use this language." The bank's chatbot was refusing to process messages containing the bank's own name. Virgin Money acknowledged the issue in a statement, said its team was "working on it," and noted the chatbot was an older model already scheduled for improvements. The incident went predictably viral.

Oopsieby Product Manager
Customers unable to get service when mentioning the company's name; public embarrassment across social media and fintech press.
AI AssistantCustomer DisserviceBrand Damage
Tombstone icon

Apple pulled AI news summaries after fake BBC headlines

Jan 2025

Apple Intelligence's notification-summary feature spent late 2024 turning news alerts into fiction with excellent lock-screen placement. In the most widely cited example, it generated a false BBC alert claiming Luigi Mangione had shot himself. The BBC complained that Apple was attaching fabricated claims to its reporting, other publishers raised similar concerns, and Apple responded in January 2025 by disabling notification summaries for News & Entertainment apps in iOS 18.3 while it reworked the feature.

Facepalmby Consumer AI feature
False breaking-news alerts on iPhones, publisher trust damage, and a public rollback by Apple.
AI HallucinationVibe JournalismProduct Failure+2 more
Tombstone icon

Cody Enterprise reporter resigned after AI fabricated quotes from real people

Aug 2024

The Cody Enterprise was forced into public apologies and corrections in August 2024 after reporter Aaron Pelczar resigned amid evidence that an AI tool he used to help write stories had inserted fabricated quotations. A competing reporter at the Powell Tribune spotted robotic phrasing, suspiciously polished source quotes, and one article that bizarrely ended by explaining the inverted pyramid style of news writing. The resulting review found seven stories that included invented or altered quotes from seven people, including Wyoming Gov. Mark Gordon. The paper removed many of the quotes, issued corrections, and then adopted an AI detection and policy response after learning, a little late, that generative text tools are not interchangeable with reporting.

Facepalmby Reporter
Seven stories tainted by fabricated or altered quotes; public apologies and corrections; reporter resigned; local newsroom credibility damaged.
AI Content GenerationAI HallucinationVibe Journalism+2 more
Tombstone icon

Meta AI answers spark backlash after wrong and sensitive replies

Jul 2024

Meta rolled out its Llama 3-powered AI assistant across Facebook, Instagram, WhatsApp, and Messenger in April 2024, replacing the familiar search bar with "Ask Meta AI anything" prompts. The assistant struggled with factual accuracy from the start - the New York Times found it unreliable with facts, numbers, and web search. In July, when asked about the Trump rally shooting, Meta AI stated the assassination attempt had not happened. Meta blamed hallucinations, updated the system, and acknowledged that "all generative AI systems can return inaccurate or inappropriate outputs."

Oopsieby AI Product
Feature restrictions; reputational damage.
AI AssistantAI HallucinationPlatform Policy+2 more
Tombstone icon

McDonald’s pulls IBM’s AI drive‑thru pilot after error videos

Jun 2024

McDonald's ended its two-year partnership with IBM on automated AI order-taking at drive-thrus in June 2024, removing the technology from more than 100 US locations. The decision followed viral TikTok videos showing the system adding nine sweet teas instead of one, inserting random butter and ketchup packets into ice cream orders, and other absurd errors. McDonald's framed the pullback as a positive, saying the test gave them "confidence that a voice-ordering solution for drive-thru will be part of our restaurants' future."

Oopsieby Operations/Product
Pilot ended; vendor reevaluation; reputational hit.
AI AssistantBrand DamageCustomer Disservice+2 more
Tombstone icon

Gemini paused people images after historical inaccuracies

Feb 2024

Google paused Gemini's image generation of people on February 22, 2024, after users discovered the tool was producing historically inaccurate depictions - including racially diverse World War II German soldiers, Black female popes, and multiethnic U.S. Founding Fathers. The overcorrection stemmed from diversity tuning meant to counter training-data biases, but the model failed to distinguish when diversity adjustments were inappropriate for specific historical prompts. CEO Sundar Pichai called the outputs "completely unacceptable." Google SVP Prabhakar Raghavan later published a blog post acknowledging the model had "overcompensated" and been "over-conservative."

Facepalmby AI Product
Feature paused; trust hit; policy and model adjustments.
AI HallucinationImage GenerationPlatform Policy+2 more
Tombstone icon

AI “Biden” robocalls told voters to stay home; fines and charges followed

Jan 2024

Two days before New Hampshire's January 2024 presidential primary, between 5,000 and 25,000 voters received robocalls featuring an AI-cloned version of President Biden's voice, complete with his trademark "what a bunch of malarkey" catchphrase. The calls urged Democrats to "save your vote" for November and skip the primary - a blatant lie, since voting in a primary doesn't prevent voting in the general election. Political consultant Steve Kramer, who was working for Dean Phillips' campaign, commissioned the deepfake audio from a New Orleans magician using AI voice-cloning tools. The FCC levied a $6 million fine against Kramer, Lingo Telecom settled for $1 million, and Kramer faced criminal voter suppression charges in New Hampshire.

Facepalmby Political Consultant
Voter confusion; enforcement actions; national scrutiny of AI voice-clones.
SafetyLegal RiskBrand Damage
Tombstone icon

DPD’s AI chatbot cursed and trashed the company

Jan 2024

UK parcel delivery firm DPD (Dynamic Parcel Distribution) had to disable its AI-powered customer service chatbot in January 2024 after customer Ashley Beauchamp demonstrated he could make it swear, call DPD "the worst delivery firm in the world," write disparaging poems about the company, and recommend competitors. The meltdown followed a system update, and Beauchamp's screenshots went viral on social media. DPD said the chatbot had operated successfully "for a number of years" before the update introduced the error, and disabled the AI element while it worked on fixes.

Facepalmby Product Manager
Public embarrassment; service channel disabled; reputational hit.
AutomationBrand DamageCustomer Disservice+1 more
Tombstone icon

Duolingo cuts contractors; ‘AI-first’ backlash

Jan 2024

In January 2024, Duolingo cut roughly 10% of its contract workforce - primarily content translators and writers who created language-learning exercises - as the company shifted to using GPT-4 and other AI tools for content generation. CEO Luis von Ahn later posted an internal "AI-first" memo on LinkedIn describing a strategy to gradually replace contractor work with AI and only hire when teams could not automate further. The memo drew hundreds of critical comments from users and language professionals. Von Ahn later admitted the memo "did not give enough context" and clarified that full-time employees were not being replaced, though user complaints about declining content quality persisted.

Facepalmby Executive
PR hit and quality complaints; ongoing AI content strategy scrutiny.
AutomationBrand DamageSlop School
Tombstone icon

Chevy dealer bot agreed to sell $76k SUV for $1

Dec 2023

Chevrolet of Watsonville, a California car dealership, deployed a customer service chatbot powered by ChatGPT and built by a company called Fullpath. After Chris White noticed the chat widget was "powered by ChatGPT," word spread online and pranksters descended. Chris Bakke manipulated the bot into "the customer is always right" mode, got it to append "and that's a legally binding offer - no takesies backsies" to every response, then asked to buy a 2024 Chevy Tahoe for $1. The bot agreed. Others got it to recommend Ford vehicles, write Python code, and provide general ChatGPT-style answers unrelated to cars. The dealership pulled the chatbot entirely.

Oopsieby Dealer Marketing/IT
Bot pulled; viral reputational bruise; no actual $1 sales.
AutomationBrand DamageCustomer Disservice+1 more
Tombstone icon

Sports Illustrated: Fake-Looking Authors and AI Content Backlash

Nov 2023

Futurism reported in November 2023 that Sports Illustrated had published product reviews under fake author names such as "Drew Ortiz" and "Sora Tanaka," whose headshots were traced to AI-generated portrait marketplaces. When questioned, SI deleted the profiles without explanation. The articles came from third-party content partner AdVon Commerce. SI said AdVon used pen names without authorization and terminated the partnership. The SI union demanded answers. Within weeks, Arena Group - SI's parent company - fired CEO Ross Levinsohn and three other executives.

Facepalmby Commerce Editorial
Content takedowns; partner terminated; trust erosion
AI Content GenerationBrand DamageVibe Journalism+2 more
Tombstone icon

Microsoft’s AI poll on woman’s death sparks outrage

Oct 2023

In late October 2023, Microsoft Start republished a Guardian article about the death of Sydney water polo instructor Lilie James and auto-attached an AI-generated "Insights" poll asking readers, "What do you think is the reason behind the woman's death?" - with options of murder, accident, or suicide. Readers blamed the Guardian's journalist directly, with some demanding the writer be fired, unaware the poll was Microsoft's AI. Guardian CEO Anna Bateson wrote to Microsoft President Brad Smith calling the poll an inappropriate use of generative AI. Microsoft deactivated all AI-generated polls on news articles and launched an investigation.

Facepalmby Product Manager
Feature disabled platform-wide; reputational damage with publishers.
AI Content GenerationBrand DamageVibe Journalism+1 more
Tombstone icon

Gannett pauses AI sports recaps after mockery

Aug 2023

In August 2023, Gannett - the largest newspaper chain in the United States - deployed an AI service called LedeAI to auto-generate high school sports recaps for the Columbus Dispatch and other papers. The articles went viral on social media for their robotic phrasing, missing player names, and bizarre constructions like "close encounter of the athletic kind." Several articles required corrections appended with notes about "errors in coding, programming or style." Gannett paused the experiment and said it would add "hundreds of reporting jobs" alongside AI tools, though the connection between the two claims was unclear.

Facepalmby Executive
Chain-wide pause of AI copy; reputational hit in local markets.
AI Content GenerationAI HallucinationBrand Damage+2 more
Tombstone icon

Snapchat’s “My AI” posted a Story by itself; users freaked out

Aug 2023

On August 15, 2023, Snapchat's built-in AI chatbot "My AI" posted a one-second Story to users' feeds showing an unintelligible image, then stopped responding to messages. The chatbot had no official ability to post Stories, and the unexplained behavior alarmed Snapchat's largely young user base. Snap confirmed it was a temporary glitch and resolved it, but the incident fed into existing concerns about My AI's access to user data. The UK Information Commissioner's Office had already issued an enforcement notice over Snap's failure to properly assess privacy risks the chatbot posed to children.

Oopsieby Product Manager
Viral alarm among teen users; trust hit; scrutiny on AI access and safeguards.
AI AssistantSafetyBrand Damage+1 more
Tombstone icon

iTutorGroup's AI screened out older applicants; $365k EEOC settlement

Aug 2023

On August 9, 2023, the EEOC's first AI-related discrimination lawsuit reached a settlement. iTutorGroup, a company providing English-language tutoring services to students in China via US-based remote tutors, had programmed its applicant screening software to automatically reject female applicants over 55 and male applicants over 60. Over 200 qualified US applicants were rejected because of their age. The company agreed to pay $365,000, adopt a new anti-discrimination policy, provide training to hiring staff, and submit to EEOC compliance monitoring for at least five years. EEOC Chair Charlotte Burrows called AI a "new civil rights frontier."

Facepalmby Executive
Older job applicants screened out; legal settlement and mandated policy changes.
Legal RiskSlop SchoolAutomation+1 more
Tombstone icon

Eating disorder helpline’s AI told people to lose weight

May 2023

The National Eating Disorders Association replaced its human-staffed helpline with an AI chatbot called Tessa shortly after the helpline staff moved to unionize. Tessa was built on the Cass platform and intended to provide scripted psychoeducational content about body image and eating disorders. Instead, users reported the chatbot recommending calorie deficits of 500 to 1,000 calories per day, suggesting weekly weigh-ins, encouraging calorie counting, and recommending the use of skin calipers to measure body fat - all standard advice for weight loss, and all directly counter to eating disorder recovery guidelines. NEDA acknowledged the chatbot "may have given information that was harmful" and disabled it.

Facepalmby Executive
Vulnerable users received unsafe guidance; reputational damage; service pulled.
AI AssistantHealthSafety+2 more
Tombstone icon

Google’s Bard ad made False JWST “first” Claim

Feb 2023

Google unveiled Bard on February 6, 2023, with a promotional ad on Twitter demonstrating the chatbot answering a question about the James Webb Space Telescope. Given the prompt "What new discoveries from the JWST can I tell my 9-year old about?", Bard stated that the JWST had taken the first pictures of a planet outside our solar system. This was false - the European Southern Observatory's Very Large Telescope captured the first direct exoplanet image in 2004. Reuters spotted the error on February 8, the day of a Google AI event in Paris. Alphabet shares dropped roughly 9% that day, erasing about $100 billion in market value.

Oopsieby Marketing
Embarrassing launch moment; stock wobble; trust in product accuracy questioned.
AI HallucinationProduct FailureBrand Damage
Tombstone icon

CNET mass-corrects AI-written finance explainers

Jan 2023

Starting in November 2022, CNET quietly published 77 financial explainer articles written by an AI tool under the byline "CNET Money Staff." Readers had to hover over the byline to learn the articles were produced "using automation technology." In January 2023, Futurism broke the story, and a follow-up identified factual errors in a compound interest article, prompting a full audit. CNET editor-in-chief Connie Guglielmo confirmed corrections were issued on 41 of the 77 articles - more than half - including some she described as "substantial." CNET paused AI-generated publishing and updated its disclosure practices, though Guglielmo said the outlet intended to continue using AI tools.

Facepalmby Executive
Large corrections; credibility hit; policy changes on AI usage.
AI Content GenerationAI HallucinationBrand Damage+3 more
Tombstone icon

Google DR AI stumbled in Thai clinics

Apr 2020

Google Health built a deep learning system capable of detecting diabetic retinopathy from retinal scans with over 90 percent accuracy in controlled lab settings. When researchers deployed it in 11 clinics across Pathum Thani and Chiang Mai in Thailand between late 2018 and mid-2019, the system rejected 21 percent of the nearly 1,840 images nurses captured as too low-quality to process - mostly due to poor clinic lighting. Slow internet connections added further delays to uploads, and nurses found themselves screening only about 10 patients per two-hour session. A tool designed to speed up triage instead created bottlenecks, patient frustration, and unnecessary specialist referrals.

Facepalmby Healthcare Pilot
Manual re-work, patient suffering, workflow disruption, health and triage impacts.
HealthProduct FailureBrand Damage