On-device AI
Also known as: edge AI · on-device LLM
On-device AI means the model runs on the device itself — a phone, laptop, or edge box — rather than in a remote data center.
- No network round-trip → lower latency, works offline.
- Data stays on the device → privacy.
- Constrained by the device’s memory and compute.
The local-LLM idea, generalized: "on-device" is the broader category; a laptop running a 7B model is on-device AI, as is a phone running a 1B model.