Small Language Model (SLM)
A small language model is a language model with relatively few parameters, typically under around ten billion, designed to run cheaply and quickly, often on phones or local devices.
What is Small Language Model (SLM)?
SLMs trade some breadth of capability for lower cost, lower latency and better privacy because data can stay on the device. They are often built by distilling knowledge from larger models.
How it works
Developers use curated training data, distillation and quantisation to fit useful capability into a compact model.
← All Artificial Intelligence & Superintelligence definitions · ← Back to the A–Z definitions