Trump administration announces funding for PTSD research on ibogaineWIRED investigation examines Jensen Huang's comments on defining women's power in techWalmart launches early Black Friday promotions on select giftsMint Mobile offers $500 discount on select new phones for new customers signing up for a yearRussia and Iran criticize U.S. Caspian task force amid reports of joint sanction evasion effortsNewly elected US lawmakers pose for traditional group photo at Capitol ahead of 120th Congress openingUS existing home sales drop to lowest monthly level in yearsPro-Palestine philanthropist faces US extradition hearing in SpainLewisham Islamic Centre criticizes charity watchdog over warning on Palestine commentsSenegalese wrestlers succeed in beach wrestling at Dakar Youth OlympicsUS nonprofits file lawsuit seeking pause on advanced AI model trainingDemocrats convene in Denver to discuss party direction after midterm victoriesUS releases report on $12bn from Venezuelan oil, mineral resourcesPope Leo XIV urges Catholic Church to address clergy sexual abuseShooting near White House results in death, suspect later found dead
All fact checks
AI analysis

Fact check

“Research has demonstrated that language models often concoct chain-of-thought explanations after the fact.”
UnverifiableConfidence: LOW

Reasoning

The MIT Technology Review article cites research indicating that LLMs often fabricate chain‑of‑thought narratives after arriving at an answer, rather than reflecting a genuine reasoning process. This directly corroborates the claim.

On confidence: The provided source explicitly states that research has shown language models generate post-hoc chain‑of‑thought explanations.

Important context

The claim pertains to the behavior of language models in generating explanations, not to their overall reasoning abilities. The source focuses on the discrepancy between the apparent deliberation and the actual generation process.

Evidence

Supporting (2)

  • Tier 1 — Primary source
    Don’t be fooled—LLMs don’t reason | MIT Technology Review

    independent, explicitly represented set of beliefs. Third, while the chains of thought chatbots produce look like deliberation, research has demonstrated that the bots often concoct them after the fact, reaching an answer by one route but…

  • Tier 1 — Primary source
    Don’t be fooled—LLMs don’t reason | MIT Technology Review

    independent, explicitly represented set of beliefs. Third, while the chains of thought chatbots produce look like deliberation, research has demonstrated that the bots often concoct them after the fact, reaching an answer by one route but…

Limitations

Only a single source is provided; while it references research, the specific studies are not detailed in the excerpt. Additional independent studies would strengthen the verification. No independent origin corroborated this claim, so it cannot be verified and confidence cannot be high.

Last verified:
Oct 2, 2026, 4:06 AM CDT
Pipeline:
2.1.0
Claim type:
Factual

Where this claim appeared

Don’t be fooled—LLMs don’t reason

MIT Technology Review · Thore Graepel