❌

Normal view

When Context Misleads: Surprisal, Energy and Attention Entropy as Metrics of Coherence Illusions in LLMs

arXiv:2606.21203v2 Announce Type: replace-cross Abstract: Psycholinguistics studies show that human readers fall for coherence illusions: an incoherent discourse can seem coherent simply because a distractor matches what comes next. We investigate whether Dutch language models (6 monolingual and 4 multilingual) show the same behavior on texts that link back to earlier context with words such as 'again' and 'too'. First, we find that surprisal at the critical word tracks human acceptability judgments and eye-tracking data. Models are more surprised by incoherent continuations, but a matching distractor in the prior context reduces this surprisal. Second, attention entropy identifies heads that behave differently under coherence vs. incoherence. We find that ablating these heads shows transfer effects across experiments, suggesting a shared mechanism. Third, we introduce energy from the associative-memory literature as a metric to quantify discourse coherence. Taken together, our results show that coherence illusions arise in Dutch LLMs, with entropy and energy exposing mechanisms that operate across settings.

Genomic atlas of Bifidobacterium infantis and B. longum informs infant probiotic design

A global genomic survey of infant gut bifidobacteria shows that B. infantis remains highly prevalent and diverse in infants from low- and middle-income countries but scarce in Western, industrialized populations and poorly represented in current probiotics. This genomic and culture collection catalogs geo-specific B. infantis strains and provides a blueprint for developing probiotics tailored to local diets and populations to support infant health.
❌