Context Window
The context window is the maximum amount of text, measured in tokens, that a language model can consider at one time, including the prompt and its own response.
What is Context Window?
Larger windows let a model read long documents or codebases in one go. Context windows have grown from a few thousand tokens to a million or more, although models may use information in the middle of very long inputs less reliably.
How it works
Everything within the window is processed through attention; text outside it is invisible to the model unless retrieved and reinserted.
← All Artificial Intelligence & Superintelligence definitions · ← Back to the A–Z definitions