Emergent Capabilities

Emergent capabilities are associated with situations in which larger models show non-linear gains over smaller models on certain tasks. The concept suggests that scaling can create not only quantitative but also qualitative differences. However, such effects must be interpreted carefully because they may depend on measurement choices, benchmarks, and evaluation design.