AI Content Generation Stories
34 disasters tagged #ai-content-generation
Book about AI and truth shipped with fake AI-generated quotes
In May 2026, Steven Rosenbaum's The Future of Truth became the wrong kind of case study when The New York Times, The Daily Beast, The Atlantic, and Ars Technica reported that the book contained multiple fake or misattributed quotes. Rosenbaum acknowledged using ChatGPT and Claude during research, writing, and editing, and accepted responsibility for what he called improperly attributed or synthetic quotes. Reporters found a fabricated quote attributed to Kara Swisher, misattributed material connected to Lisa Feldman Barrett, and a Meredith Broussard quote placed in the wrong source. Ars reported that six outside citations had been identified as problematic. A book warning about synthetic truth managed to demonstrate the footgun in hardcover.
EY Canada pulled a cyber report after researchers found fake citations
On May 14, 2026, GPTZero published an investigation into EY Canada's loyalty-fraud cybersecurity report, Points of Attack, and said the 44-page document was loaded with hallucinated references, broken or fake source URLs, misattributed statistics, and text that scanned as AI-written. EY Canada then removed the report from its website and said it was reviewing how it was published. For a firm selling trust, controls, and responsible AI advice, having a public report fall over at the bibliography is a rough little invoice from reality.
AI-made citations are polluting published research by the thousand
A January 2026 conference-paper analysis, an April Nature investigation, and a May 2026 Lancet biomedical audit all point to the same ugly conclusion: AI-hallucinated references are no longer isolated embarrassments. GhostCite found a sharp jump in unverifiable citations in 2025 computer-science conference papers. Nature estimated that tens of thousands of 2025 publications may contain invalid AI-generated references. The Lancet audit then found 4,046 fabricated references across 2,810 PubMed Central papers. The problem is no longer just that chatbots invent papers. It is that those inventions are surviving long enough to contaminate the literature and force publishers into cleanup work they clearly did not plan for.
A scan of 380,000 vibe-coded apps found 5,000 leaking sensitive data
In early May 2026, Israeli cybersecurity startup RedAccess published findings from a scan of roughly 380,000 applications built on vibe-coding platforms, including Lovable, Base44, Replit, and Netlify. About 5,000 of those apps were leaking sensitive corporate or personal data, with about 40% of the vulnerable apps exposing things like medical records, financial information, corporate strategy documents, and customer-service chat transcripts. Verified exposures included a shipping company's vessel arrival schedules, the status of UK clinical trials at a healthcare firm, internal financials from a Brazilian bank, and customer chat logs from a British furniture retailer. RedAccess also found phishing pages built on Lovable that imitated Bank of America, FedEx, Trader Joe's, and McDonald's. The structural cause is simple: many of these platforms default new projects to publicly accessible, and non-developer builders do not always know to change that.
Palo Alto family sued in federal court over a 76% Turnitin "AI" score
In May 2026, a Palo Alto family filed a federal civil rights complaint against Palo Alto Unified after their high school sophomore's English essay was flagged as 76% likely AI-generated by Turnitin's AI-writing detector. The district ordered an in-class handwritten rewrite as the corrective step. The family alleges that the assistant principal then had a school secretary type up both the handwritten rewrite and the final exam and ran those typed versions through Turnitin again, without notifying the family or getting consent. The original Turnitin score knocked the student's semester grade from a low A or high B down to a C, with knock-on consequences for college prospects. The family submitted roughly 1,200 pages of evidence including drafts, notes, and document revision history. The complaint also alleges unequal application of the detector by gender and race in the same classroom.
Google AI Overview allegedly branded a fiddler as a sex offender
Canadian musician Ashley MacIsaac sued Google after its AI Overview allegedly confused him with another person, falsely described him as a convicted sex offender, and helped get a December 2025 concert canceled. Google later changed the result, but the lawsuit says the damage was already done: reputational harm, lost work, safety fears, and a $1.5 million defamation claim over a machine-generated biography that apparently could not manage the demanding research task of checking which Ashley MacIsaac it was talking about.
NEJM retracted a case study after authors used AI to alter a clinical image
On May 1, 2026, the New England Journal of Medicine retracted an "Images in Clinical Medicine" piece titled "Bronchial Casts from Inhalation of Forest-Fire Smoke" - eleven days after publishing it. The dramatic photograph of black, branching airway casts pulled from an 87-year-old patient's lungs had spread beyond the journal and drawn media attention. The two authors then admitted they had used an AI tool to superimpose the tape measure visible at the top of the image. They told the journal they were unaware of NEJM's policies on image manipulation and described the alteration as a cosmetic adjustment for readability. The clinical content was apparently authentic, but the most prestigious medical journal in the United States still had to retract a case study because part of the figure had quietly been generated by AI.
South Africa withdrew its draft AI policy after finding fictitious sources in the references
South Africa's Department of Communications and Digital Technologies withdrew its Draft National Artificial Intelligence Policy after officials confirmed the reference list contained fictitious sources. Communications Minister Solly Malatsi said the most plausible explanation was unverified AI-generated citations and called the lapse serious enough to compromise the draft's integrity and credibility. This is vibe-lawyering wearing a government badge: an official policy about regulating AI tripped over the exact hallucination problem that every first-year ChatGPT cautionary slide already warned about.
Purdue's CS 240 professor accused 200+ students of AI cheating, then walked it back
In late April 2026, the instructor of Purdue's CS 240 computer science course emailed more than 200 students accusing them of using AI on assignments. The email cited "clear and concrete indicators" of AI use, landed on the last day students could drop the class, and warned of course failure plus referral to the dean of students. Students had five days to fill out an online form describing which assignments they had used AI on. Outcry followed quickly, and the allegations were dropped within days. The instructor told students he understood the timing could be seen as "coercive." His own data, made available later, showed AI agents performing 10 to 15 percentage points worse than human students on the same assignments - which makes a blanket "200+ of you cheated with AI" assumption hard to support on the merits the professor had in hand.
The New York Times printed an AI-generated "quote" that Pierre Poilievre never said
On April 14, 2026, the New York Times published a Canadian-election analysis piece by its Canada bureau chief that included a direct quotation attributed to Conservative Party leader Pierre Poilievre. He never said it. The wording turned out to be an AI-generated summary of his views that the AI tool had formatted as a quotation, and it sailed through whatever editing process the Times had in place. A Bluesky reader flagged the error the next day. The correction did not run until May 1, more than two weeks later. Days after the incident drew wider attention, the Times rolled out new guidance restricting AI use, but only for freelancers; the staff reporter who filed the original piece was not the target audience for the new rule.
Nota shut down its AI local news network after it was caught copying local reporters
Nota launched an 11-site local news network in 2025 with the usual "underserved communities" rhetoric and the less-usual decision to let AI-assisted workflows repurpose other people's reporting. By early April 2026, Axios Richmond and Poynter had documented widespread plagiarism, including lifted quotes, paraphrased reporting, and reused photos from local outlets. Nota fired one editor, took down the network, and signaled the sites were likely gone for good. The promised fix for news deserts lasted about as long as it took actual local reporters to notice their work had been stolen.
The New York Times dropped Alex Preston after an AI-assisted review copied a Guardian review
A January 6, 2026 New York Times review of Jean-Baptiste Andrea's Watching Over Her was updated on March 30 with an editor's note acknowledging that it contained language and details similar to an earlier Guardian review. On March 31, reporting from The Guardian said the Times had cut ties with freelance reviewer Alex Preston after he admitted using an AI tool that pulled material from the earlier review into his draft. It was not a hallucination story. AI-assisted writing can still smuggle plagiarism into a flagship desk and out the door before anyone notices.
Mediahuis suspended senior journalist over AI-invented quotes
Mediahuis suspended veteran journalist Peter Vandermeersch after reporting found AI-generated quotes in his work. Euronews reported that 15 of 53 articles included fabricated expert quotes, with multiple quoted individuals saying they had not made the attributed remarks. Vandermeersch acknowledged relying on tools such as ChatGPT, Perplexity, and Google's Notebook tools to summarize source material, then trusting the outputs too much.
Metacritic briefly carried an AI-written Resident Evil Requiem review
In February 2026, Metacritic briefly listed a positive Resident Evil Requiem review from VideoGamer under the byline Brian Merrygold, a critic whose profile image and online footprint quickly drew suspicion. Readers and games writers flagged the review as AI-generated slop, Metacritic removed it, and the aggregator said outlets caught using AI-written reviews would no longer be accepted. The incident was smaller than a full newsroom collapse, but it landed on a platform whose entire value proposition is that the reviews it aggregates come from real critics rather than synthetic enthusiasm engines.
Ars Technica fires senior AI reporter after AI tool fabricated quotes in published story
Ars Technica retracted an article by senior AI reporter Benj Edwards after it contained fabricated quotations generated by an AI tool and attributed to a source who never said them. The publication acknowledged the incident as a "serious failure of our standards" and Edwards was subsequently fired. Edwards noted the irony on Bluesky: "The irony of an AI reporter being tripped up by AI hallucination is not lost on me."
Guardian investigation finds Google AI Overviews gave dangerous health misinformation
A Guardian investigation found Google's AI Overviews displayed false and misleading health information across multiple medical topics. AI summaries gave incorrect liver function test ranges sourced from an Indian hospital chain without accounting for nationality, sex, or age. The feature advised pancreatic cancer patients to avoid high-fat foods, which experts said could increase mortality risk. Stanford and MIT researchers called the absence of prominent disclaimers a critical danger. Google removed some AI Overviews for health queries after the investigation, but many remained active.
AI police report claims officer shape-shifted into a frog
Heber City Police Department's Axon Draft One AI report tool transcribed background dialogue from The Princess and the Frog playing on a television into an official police report, claiming an officer had shape-shifted into a frog while conducting police activity. The incident exposed design flaws in AI report-writing tools that process all body camera audio without distinguishing between relevant police interactions and ambient background noise.
Amazon pulled Prime Video's AI recaps after Fallout errors
Amazon launched Prime Video "Video Recaps" as a beta generative-AI feature meant to help viewers catch up between seasons. A recap for Fallout instead got basic plot points wrong, including mislabeling one of The Ghoul's flashbacks as "1950s America" rather than 2077 and misdescribing a key scene with Lucy. Prime Video then pulled the recap feature from the shows in the test program, which is not ideal for a tool whose entire job is remembering the plot.
Washington Post launched AI podcast that failed its own quality tests at an 84% rate
The Washington Post launched "Your Personal Podcast," an AI-generated audio news product, in December 2025 despite internal testing showing that between 68% and 84% of AI-generated scripts failed to meet the publication's editorial standards across three rounds of evaluation. The AI fabricated quotes from public figures, misattributed statements, mispronounced names, and inserted its own editorial commentary as if it were the Post's position. The internal review concluded that "further small prompt changes are unlikely to meaningfully improve outcomes without introducing more risk." The product team recommended launching anyway. Post editors revolted, with one writing in Slack that it was "truly astonishing that this was allowed to go forward at all."
Deloitte gets caught using AI hallucinations in a government report - again
Seven weeks after Deloitte Australia agreed to partially refund a government contract over AI-fabricated citations, a Newfoundland and Labrador journalist discovered that Deloitte Canada's $1.6 million healthcare workforce report contained at least four fabricated academic citations from papers that don't exist. The fake references named real researchers as co-authors of fictional studies - researchers who confirmed they never wrote the cited work. Deloitte admitted AI was "selectively used to support a small number of research citations," stood by the report's findings, and offered no refund. The province's accounting watchdog launched a formal investigation, and Newfoundland became one of the first Canadian provinces to require AI disclosure in government contracts.
Deloitte to refund Australian government after AI-generated report
Deloitte Australia agreed to partially refund a $440,000 contract after admitting its welfare compliance review for the Department of Employment and Workplace Relations contained fabricated academic citations and a fictitious judicial quote generated by Azure OpenAI GPT-4o. University of Sydney researcher Christopher Rudge found the revised report introduced even more hallucinated references than the original.
Anthropic agrees to $1.5B payout over pirated books
Anthropic accepted a $1.5 billion settlement with authors who said the Claude team scraped pirate e-book sites to train its chatbot. The deal pays roughly $3,000 per book across 500,000 works, heads off a December trial, and forces one of the richest AI startups to bankroll the writing community it previously treated as free training data.
An AI-made freelancer fooled WIRED and Business Insider
In 2025, outlets including WIRED and Business Insider published articles under the byline Margaux Blanchard, a freelancer who appears not to exist. WIRED later published a postmortem admitting that one commissioned feature slipped past its usual defenses, including human review and even two commercial AI detectors, before editors discovered fabricated details and retracted it. Business Insider first removed Blanchard essays and then, after a broader internal probe, pulled at least 34 more pieces tied to dubious bylines and said it had strengthened verification protocols. The failure was not one chatbot going rogue. It was multiple newsroom workflows accepting AI-shaped fiction as publishable reporting.
AI-generated npm pkg stole Solana wallets
A malicious npm package called @kodane/patch-manager, apparently generated using Anthropic's Claude, posed as a legitimate Node.js utility while hiding a Solana wallet drainer in its post-install script. The package accumulated over 1,500 downloads before npm removed it on July 28, 2025, draining cryptocurrency funds from developers who installed it without realizing the payload ran automatically with no further user action required.
Reporter fired after AI tool provided by her employer fabricated sources in front-page article
Wisconsin State Journal reporter Audrey Korte was fired in July 2025 after publishing a front-page article about a downtown Madison development plan that contained factual errors and fabricated sources generated by an AI tool. The tool had been provided by the newspaper's parent company, Lee Enterprises, and was installed on employee computers. Korte said she used it for grammar and style editing, but it introduced false information she didn't catch before publication. The article was pulled, replaced with a re-reported version, and stamped with a disclaimer citing "unauthorized AI use" and "fabricated sources." Korte was terminated. She publicly accepted responsibility for not catching the errors but noted she had received no training on the tool that was already installed on her work computer.
White House MAHA report shipped fake studies and OpenAI citation markers
On May 29, 2025, NOTUS reported that the White House's Make America Healthy Again report cited studies that did not exist and mischaracterized others. PolitiFact, the Washington Post, and congressional oversight Democrats later pointed to classic AI-citation red flags, including fake paper titles, broken DOI links, and "oaicite" markers associated with OpenAI citation output. The White House called the problems formatting issues and updated the report. Public health policy apparently got the same bibliography QA as a panicked term paper, because history has a dark sense of humor.
Syndicated AI book list ran in major papers with made-up titles
A freelance writer working for King Features Syndicate used AI to research a summer reading list for the Chicago Sun-Times and Philadelphia Inquirer. Of the fifteen books recommended, only five were real. The rest were hallucinated titles attributed to real authors like Isabel Allende and Delia Owens. The list ran in print in a 64-page special section before 404 Media, NPR, and others exposed the fabrications. Both newspapers issued corrections and statements distancing their newsrooms from the syndicated content.
California's failed bar exam included AI-drafted questions
The State Bar of California disclosed in April 2025 that 23 scored multiple-choice questions on its already troubled February bar exam were developed with AI assistance by its psychometric vendor, ACS Ventures. Test-takers had already reported crashes, lag, copy-paste failures, and lost answers. Then the bar admitted that some questions in this licensing exam for future lawyers had been drafted with AI, reviewed by the same outside vendor, and used anyway. The bar asked the California Supreme Court for score relief, while legal academics described the admission as staggering.
LA Times had to pull AI "Insights" after it softened the Klan
The Los Angeles Times launched an AI feature called "Insights" in March 2025 to label opinion pieces, summarize them, and generate an opposing viewpoint. It immediately attached itself to a Gustavo Arellano column about Anaheim's history with the Ku Klux Klan and produced language suggesting the 1920s Klan could be framed as a response to social change rather than as an explicitly hate-driven movement. The feature was removed from that article within a day. The newspaper had managed to bolt an automated both-sides machine onto a hate group history piece and act surprised when that went badly.
Cody Enterprise reporter resigned after AI fabricated quotes from real people
The Cody Enterprise was forced into public apologies and corrections in August 2024 after reporter Aaron Pelczar resigned amid evidence that an AI tool he used to help write stories had inserted fabricated quotations. A competing reporter at the Powell Tribune spotted robotic phrasing, suspiciously polished source quotes, and one article that bizarrely ended by explaining the inverted pyramid style of news writing. The resulting review found seven stories that included invented or altered quotes from seven people, including Wyoming Gov. Mark Gordon. The paper removed many of the quotes, issued corrections, and then adopted an AI detection and policy response after learning, a little late, that generative text tools are not interchangeable with reporting.
Sports Illustrated: Fake-Looking Authors and AI Content Backlash
Futurism reported in November 2023 that Sports Illustrated had published product reviews under fake author names such as "Drew Ortiz" and "Sora Tanaka," whose headshots were traced to AI-generated portrait marketplaces. When questioned, SI deleted the profiles without explanation. The articles came from third-party content partner AdVon Commerce. SI said AdVon used pen names without authorization and terminated the partnership. The SI union demanded answers. Within weeks, Arena Group - SI's parent company - fired CEO Ross Levinsohn and three other executives.
Microsoft’s AI poll on woman’s death sparks outrage
In late October 2023, Microsoft Start republished a Guardian article about the death of Sydney water polo instructor Lilie James and auto-attached an AI-generated "Insights" poll asking readers, "What do you think is the reason behind the woman's death?" - with options of murder, accident, or suicide. Readers blamed the Guardian's journalist directly, with some demanding the writer be fired, unaware the poll was Microsoft's AI. Guardian CEO Anna Bateson wrote to Microsoft President Brad Smith calling the poll an inappropriate use of generative AI. Microsoft deactivated all AI-generated polls on news articles and launched an investigation.
Gannett pauses AI sports recaps after mockery
In August 2023, Gannett - the largest newspaper chain in the United States - deployed an AI service called LedeAI to auto-generate high school sports recaps for the Columbus Dispatch and other papers. The articles went viral on social media for their robotic phrasing, missing player names, and bizarre constructions like "close encounter of the athletic kind." Several articles required corrections appended with notes about "errors in coding, programming or style." Gannett paused the experiment and said it would add "hundreds of reporting jobs" alongside AI tools, though the connection between the two claims was unclear.
CNET mass-corrects AI-written finance explainers
Starting in November 2022, CNET quietly published 77 financial explainer articles written by an AI tool under the byline "CNET Money Staff." Readers had to hover over the byline to learn the articles were produced "using automation technology." In January 2023, Futurism broke the story, and a follow-up identified factual errors in a compound interest article, prompting a full audit. CNET editor-in-chief Connie Guglielmo confirmed corrections were issued on 41 of the 77 articles - more than half - including some she described as "substantial." CNET paused AI-generated publishing and updated its disclosure practices, though Guglielmo said the outlet intended to continue using AI tools.