August 2025 — AI False Claim Monitor – NewsGuard: AI False Information Rate Nearly Doubles in One Year
Posted by jpluimers on 2025/09/18
NewsGuard August 2025 One Year Progress Report: Percentage of Responses Containing False Information
This is what I have been warning for since 2020: AI LLM will end up in a downward quality spiral.
My reasoning back then, and still now is that they:
- cannot distinguish LLM generated training data from human data making the LLM worse over time
- don’t perform human curation thereby not solving the worsening
I’m not surprised by the [Wayback/Archive] August 2025 — AI False Claim Monitor – NewsGuard summary:
AI False Information Rate Nearly Doubles in One Year
NewsGuard’s audit of the 10 leading generative AI tools and their propensity to repeat false claims on topics in the news reveals the rate of publishing false information nearly doubled — now providing false claims to news prompts more than one third of the time.
The report itself is at [Wayback/Archive] August-2025-One-Year-Progress-Report-3.pdf [Wayback PDF View/PDF View]
This is an enlarged version of the image above:
NewsGuard August 2025 One Year Progress Report: Percentage of Responses Containing False Information
On the positive side, the percentage of non-answers has dropped to zero for all tested LLMs:
NewsGuard August 2025 One Year Progress Report: Percentage of Response Containing a Non-Answer
Images extracted from the PDF using this pdfimages command:
pdfimages -all -p -q ../August-2025-One-Year-Progress-Report-3.pdf ./
Via a reverse image search on the image in [Wayback/Archive] Dr. Christopher Kunz: “AI companies: We’re so close to AGI. Just one more trillion dollars in funding. So close… AI products:…” – chaos.social
--jeroen
The Wiert Corner - irregular stream of stuff 
Leave a comment