Results for "top-p"
Top-p
IntermediateSamples from the smallest set of tokens whose probabilities sum to p, adapting set size by context.
Beam Search
Intermediate
Search algorithm for generation that keeps top-k partial sequences; can improve likelihood but reduce diversity.
Top-k
Intermediate
Samples from the k highest-probability tokens to limit unlikely outputs.
Top-p
Intermediate
Samples from the smallest set of tokens whose probabilities sum to p, adapting set size by context.