Sampling

Sampling determines which token, visual structure, or audio unit will be selected from the probability distribution learned by a generative model. The balance between deterministic output and creative diversity is largely shaped by the sampling strategy. For that reason, not only model quality but also decoding and sampling policy directly affect final output behavior.