AhaBulbStuff Everyone Should Know
AhaBulb: Stuff Everyone Should Know · ahabulb.com/ai-dropout-randomly-removes-units

What does dropout randomly remove during a training step?

Start playing free

  1. All training labels
  2. Random units and connections
  3. The optimizer permanently

🔒 The answer is for AhaBulb members. Members see the answer, why it's right and the official sources for every card of Stuff Every AI Expert Should Know, plus timed practice exams.

The first 50 cards of every test are free to play.

Play the free cards See membership

Like this card?
Play the game

References

  1. Dropout: A Simple Way to Prevent Neural Networks from Overfitting www.jmlr.org/papers/v15/srivastava14a.html Checked 2026-10-10.

Think this answer is wrong? Tap "Challenge this answer" on the card in the game and tell us why.

Test yourself in the game

Artificial IntelligenceWhat did AlexNet's authors use to reduce overfitting in its fully connected layers?Artificial IntelligenceA model scores great on its training data but badly on new data. What is that called?Artificial IntelligenceTraining error is far lower than test error. Which problem does that point to?

That's stuff everyone should know.