AI 101

Small Language Model (SLM)

Also known as: SLM · small LLM

Local

A small language model (SLM) is a compact LLM — typically 1–8 billion parameters — built to run quickly on phones, laptops, and edge devices.

  • Fast and cheap to run.
  • Good enough for many everyday tasks.
  • The workhorse of on-device AI.

The size philosophy: an SLM trades raw capability for speed, privacy, and cost. For many tasks, a well-prompted SLM is the right tool.