AhaBulbStuff Everyone Should Know
AhaBulb: Stuff Everyone Should Know · ahabulb.com/ai-llm-next-token-prediction

At its core, what is a large language model trained to do?

Start playing free

  1. Predict the next token from earlier tokens
  2. Look up answers in a stored database
  3. Copy whole sentences it memorized

🔒 The answer is for AhaBulb members. Members see the answer, why it's right and the official sources for every card of Stuff Every AI Expert Should Know, plus timed practice exams.

The first 50 cards of every test are free to play.

Play the free cards See membership

Like this card?
Play the game

References

  1. Google Machine Learning Glossary: Generative AI (auto-regressive model) developers.google.com/machine-learning/glossary/generative Checked 2026-10-10.
  2. Google ML Crash Course: LLMs and Transformers developers.google.com/machine-learning/crash-course/llm/transformers Checked 2026-10-10.

Think this answer is wrong? Tap "Challenge this answer" on the card in the game and tell us why.

Test yourself in the game

Artificial IntelligenceWhy does an autoregressive Transformer decoder mask later positions?Artificial IntelligenceWhat does an LLM's context window measure?Artificial IntelligenceWhat two kinds of memory does retrieval-augmented generation (RAG) combine?

That's stuff everyone should know.