Bitter Lesson
The bitter lesson is Richard Sutton's 2019 observation that general methods that scale with computation, such as search and learning, have historically beaten approaches built on human knowledge.
What is Bitter Lesson?
It is often cited to explain the success of scaling large models.
How it works
As compute grows, general learning methods overtake hand-engineered ones.
← All Artificial Intelligence & Superintelligence definitions · ← Back to the A–Z definitions