Curriculum learning
Also known as: curriculum
Curriculum learning is structuring the training data from easy to hard, the way a teacher would. Start with simple examples, gradually raise the difficulty.
It often stabilizes training and improves final quality versus shuffling everything randomly.
- Early: short, simple, clear examples.
- Late: long, complex, subtle ones.
The intuition: learning a skill benefits from scaffolding. Curriculum learning applies that intuition to the data order.