Emergent ability

An emergent ability is a skill that pops into existence once a model gets big enough — absent (or nearly so) in smaller models. Multi-step reasoning and reliable in-context learning are the classic examples.

It’s “emergent” because it doesn’t scale smoothly with size; it appears past a threshold.

• Small model: can’t chain three steps of logic.
• Big model: does it reliably.