Rust SDK
The mistralrs crate embeds the engine into a Rust program.
- Getting started - load a model in-process and send a chat request.
- Streaming - handle
Responsevariants, tool progress, and cancellation. - Embed in Axum - mount the HTTP API inside an existing Axum app.
- Rust SDK reference - summary of the
ModelAPI. - docs.rs - full API documentation.