AI 101

Private deployment

Also known as: self-hosted · on-prem LLM

Local

A private deployment is a model running inside your infrastructure — a VPC, an on-prem server, or a local box — rather than a provider’s shared cloud.

  • Data stays in your perimeter.
  • You control access, retention, and upgrades.
  • You also own the ops, security, and hardware.

The enterprise answer: when "don't send our data to a third party" is the requirement, private deployment (often with vLLM) is the standard architecture.