Quickstart
Run a model on your computer and chat with it in your browser.
Install
Section titled “Install”curl -fsSL https://mistralrs.dev/install.sh | shirm https://mistralrs.dev/install.ps1 | iexFollow the installer, then open a new terminal.
Chat in your browser
Section titled “Chat in your browser”Start a model:
mistralrs serve -m Qwen/Qwen3-4B --quant 4When the server is ready, open http://localhost:1234/ui and send a message.
Keep the terminal open while you chat. Press Ctrl+C when you’re done.