Skip to content

Deploy

When mistral.rs runs anywhere other than a development laptop, several development conveniences (ephemeral storage, no TLS, single model, forgiving network) no longer apply.

  • Docker: building and running the official container images.
  • Production checklist: pre-flight: TLS termination, authentication, observability, model warm-up, monitoring.

For configuration options (host, port, CORS, body limits), see the HTTP server guide.