Module mistralrs_for_server_builder 

mistral.rs instance for server builder.

Modules

defaults

Structs

MistralRsForServerBuilder

A builder for creating a mistral.rs instance with configured options for the mistral.rs server.

ModelConfig

Configuration for a single model in a multi-model setup

Functions

configure_paged_attn_from_flags

Configures PagedAttention based on two flags.

get_search_embedding_model

Creates a search embedding model configuration for agentic search reranking.