AhaBulbStuff Everyone Should Know
AhaBulb: Stuff Everyone Should Know · ahabulb.com/ai-nucleus-top-p-sampling

What does nucleus (top-p) sampling do when picking the next token?

Start playing free

  1. Always picks the single most likely token
  2. Picks any token in the vocabulary equally
  3. Samples from the top tokens, dropping the unlikely tail

🔒 The answer is for AhaBulb members. Members see the answer, why it's right and the official sources for every card of Stuff Every AI Expert Should Know, plus timed practice exams.

The first 50 cards of every test are free to play.

Play the free cards See membership

Like this card?
Play the game

References

  1. Holtzman et al., The Curious Case of Neural Text Degeneration (arXiv 1904.09751) arxiv.org/abs/1904.09751 Checked 2026-10-10.

Think this answer is wrong? Tap "Challenge this answer" on the card in the game and tell us why.

Test yourself in the game

Artificial IntelligenceHow do AI, machine learning and deep learning fit together?Artificial IntelligenceWhat did Alan Turing call his 1950 test of machine intelligence?Artificial IntelligenceTuring predicted that by about 2000, judges would ID the machine at most what percent of the time?

That's stuff everyone should know.