Consumer GPU
Also known as: gaming GPU · desktop GPU
A consumer GPU is a card sold for desktops and laptops — the RTX 30/40/50 series, Apple’s discrete GPUs, etc.
- Typical VRAM: 8–24 GB.
- Plenty for 7–13B models (and 70B with offload).
- The hardware most “local LLM” guides assume.
Your likely starting point: a 12–16 GB consumer GPU comfortably runs 7B–13B models at good speed — the sweet spot for most hobbyists.