AhaBulbStuff Everyone Should Know
AhaBulb: Stuff Everyone Should Know · ahabulb.com/ai-rlhf-ranked-outputs

In RLHF as used for InstructGPT, what did human labelers provide for the reinforcement learning step?

Start playing free

  1. New training text from the web
  2. Rankings of several model outputs
  3. Corrections to the model's weights

🔒 The answer is for AhaBulb members. Members see the answer, why it's right and the official sources for every card of Stuff Every AI Expert Should Know, plus timed practice exams.

The first 50 cards of every test are free to play.

Play the free cards See membership

Like this card?
Play the game

References

  1. Ouyang et al., Training language models to follow instructions with human feedback (arXiv 2203.02155) arxiv.org/abs/2203.02155 Checked 2026-10-10.

Think this answer is wrong? Tap "Challenge this answer" on the card in the game and tell us why.

Test yourself in the game

Artificial IntelligenceIn the InstructGPT study, which answers did people prefer: a 1.3B RLHF model's or the 175B GPT-3's?Artificial IntelligenceWhat does Direct Preference Optimization (DPO) replace RLHF's reinforcement learning with?Artificial IntelligenceHow do AI, machine learning and deep learning fit together?

That's stuff everyone should know.