Epoch
An epoch is one complete pass of a training algorithm through the whole training dataset.
What is Epoch?
Smaller models are often trained for many epochs, while very large language models may see most of their data only about once. Training for too many epochs can lead to overfitting.
How it works
If a dataset has 10,000 examples and the batch size is 100, one epoch consists of 100 parameter updates.
← All Artificial Intelligence & Superintelligence definitions · ← Back to the A–Z definitions