Computer use
Also known as: computer-using agent · GUI agent
Computer use is an agent that controls a real computer: it sees the screen and drives mouse and keyboard to operate apps.
- Works with any GUI app, no API needed.
- Slower and more brittle than tool calls.
- The broadest — and riskiest — form of agency.
The trade-off: computer use reaches anywhere, but it's slow, ambiguous, and can do real damage. Use it when there's no API — and sandbox it hard when there is.