Most of our measures of a key cognitive process don't agree
By John Timmer · Nov 2, 2026, 1:13 PM CST
It's widely acknowledged that it's nearly impossible to publish negative results in scientific journals. "We didn't see anything" is a much harder sell than finding that a hypothesis is clearly right. Findings of no effect tend to either be shuffled off to low-profile journals or left behind as unpublished lab lore. The high-profile journal Nature, however, made a notable exception this week, publ
Excerpt shown under fair-use limits. Full text remains with the original publisher.
People in this coverage
Explore their history and attributable record. Being mentioned does not imply endorsement.
Layer 1 · Claims & fact checks
AI analysisLayer 3 · Reporting analysis
AI analysisAppeal to AuthorityCiting Nature is used to lend credibility to the claim without summarizing the study's methodology or findings.
Framing of NegativityFrames the scientific publishing system as biased, setting up the Nature article as a corrective breakthrough.
SensationalismUses vague language ('a bunch of methods') and strong phrasing ('don't seem to be measuring the same thing') to suggest a crisis without providing specifics.
Implicit CausalityInfers that measurement issues directly undermine CBT effectiveness, a leap not substantiated by presented evidence.
Context
AI analysisMissing context
The article provides no details about the Nature study: sample size, specific measurement methods evaluated, statistical results, authors, or how the conclusions were reached. It also lacks discussion of alternative explanations, prior literature on measurement convergence, or any expert commentary.
Important context
The piece raises the broader issue of publication bias against null results, which can affect the perceived reliability of scientific findings. It also touches on the role of cognitive reappraisal in CBT and the need for robust psychometric tools to assess related emotional processes.
Opinion vs. reporting
AI analysisThe article blends reporting with opinion. It reports on a Nature study but intersperses evaluative language (e.g., "widely acknowledged," "much harder sell") and draws broader conclusions without presenting supporting data.