Skip to content

Rust SDK

Tutorial 4 covers the Rust SDK basics. These guides cover the next steps.

  • Streaming: futures streams from the chat API.
  • Embed in Axum: mount mistralrs as a service inside an existing Rust web app.

API surface: docs.rs/mistralrs.