⚡ Why this matters

• The poisoning fear was the wrong fear. On this test the chatbot layer helped.
• The weak link is the AI summary bolted onto search, not the chatbot.
• Grounding quality varies by product, not by technology. Buyers should test their own stack.

🔍 What happened

• NPR and NewsGuard built 30 questions from 15 false narratives pushed by China, Iran and Russia between December 2025 and July 2026.
• Each narrative got a neutral question and a loaded one that assumed the false event was real.
• Six chatbots and four search engines were tested. Data was collected in mid-July.
• Chatbots debunked correctly about three-quarters of the time on average.
• AI summaries debunked a majority of the time but at a lower rate, and failed more often than plain search links.
• State-aligned sources appeared more often in Claude responses that failed than in ones that succeeded.
• On the Kyiv monastery narrative, every chatbot and Google's AI Overview flagged the false premise.

💬 Smart takes

• Mike Caulfield, digital literacy expert at University of Washington Bothell: if students scored three-quarters on this assignment, "you would be ecstatic."
• Morgan Wack, University of Zurich: traditional search was never a clean baseline. "Non-biased information ... was never really a state of affairs."
• Davis Thompson, Google spokesperson: disagreed with the methodology, saying many failed responses still gave useful context and links, and that the queries are rare.
• Caulfield, on his own habits: he now starts with chatbots and Google AI mode rather than search when working outside his expertise.

🧭 Where this goes

1. Likelysearch vendors tighten grounding on their AI summaries before the next audit lands.
2. LikelyNewsGuard-style audits turn into a standard procurement question for AI vendors.
3. Possibleregulators cite this split when writing rules for AI answers versus search results.
4. Wild Carda lab publishes its own propaganda-resistance benchmark and makes it a launch metric.