Glossary · How models work

Small language model (SLM)

Also called SLM, on-device model

A small language model is a compact model, usually a few billion parameters or fewer, designed to run cheaply or directly on a phone or laptop. It handles focused tasks well, without sending your text to a remote server.

An example

Phone features that summarise notifications or suggest replies offline often use a small on-device model.

Why it matters to people

On-device AI can be the more private option, and it works without a connection — useful in rural and northern communities with patchy internet.