AhaBulbStuff Everyone Should Know
AhaBulb: Stuff Everyone Should Know · ahabulb.com/ai-constitutional-ai-rlaif

In Constitutional AI, what is the only human oversight used to judge harmfulness?

Start playing free

  1. A written list of rules or principles
  2. Thousands of human harm labels
  3. A human reading every answer

🔒 The answer is for AhaBulb members. Members see the answer, why it's right and the official sources for every card of Stuff Every AI Expert Should Know, plus timed practice exams.

The first 50 cards of every test are free to play.

Play the free cards See membership

Like this card?
Play the game

References

  1. Bai et al., Constitutional AI: Harmlessness from AI Feedback (arXiv 2212.08073) arxiv.org/abs/2212.08073 Checked 2026-10-10.

Think this answer is wrong? Tap "Challenge this answer" on the card in the game and tell us why.

Test yourself in the game

Artificial IntelligenceIn the InstructGPT study, which answers did people prefer: a 1.3B RLHF model's or the 175B GPT-3's?Artificial IntelligenceWhat causes specification gaming in an AI system?Artificial IntelligenceWhat are the two broad targets of reward tampering?

That's stuff everyone should know.