List of all items

Structs

• background_tasks::BackgroundTask
• background_tasks::BackgroundTaskManager
• cached_responses::InMemoryResponseCache
• mistralrs_for_server_builder::MistralRsForServerBuilder
• mistralrs_for_server_builder::ModelConfig
• mistralrs_server_router_builder::MistralRsServerRouterBuilder
• openai::ChatCompletionRequest
• openai::CompletionRequest
• openai::EmbeddingData
• openai::EmbeddingRequest
• openai::EmbeddingResponse
• openai::EmbeddingUsage
• openai::FunctionCalled
• openai::ImageGenerationRequest
• openai::JsonSchemaResponseFormat
• openai::Message
• openai::MessageContent
• openai::MessageInnerContent
• openai::ModelObject
• openai::ModelObjects
• openai::ResponsesAnnotation
• openai::ResponsesChunk
• openai::ResponsesContent
• openai::ResponsesCreateRequest
• openai::ResponsesDelta
• openai::ResponsesDeltaContent
• openai::ResponsesDeltaOutput
• openai::ResponsesError
• openai::ResponsesIncompleteDetails
• openai::ResponsesInputTokensDetails
• openai::ResponsesObject
• openai::ResponsesOutput
• openai::ResponsesOutputTokensDetails
• openai::ResponsesUsage
• openai::SpeechGenerationRequest
• openai::ToolCall
• responses::IncludeConfig
• responses::OpenResponsesCreateRequest
• responses::OpenResponsesStreamer
• responses::ReasoningConfig
• responses::RequestContext
• responses::StreamOptions
• responses::TextConfig
• responses_types::content::AudioInput
• responses_types::content::FileCitation
• responses_types::content::FilePathInfo
• responses_types::content::ImageUrl
• responses_types::content::UrlCitation
• responses_types::events::OutputItemState
• responses_types::events::StreamingState
• responses_types::items::MessageItemParam
• responses_types::resource::FunctionDefinition
• responses_types::resource::IncompleteDetails
• responses_types::resource::InputTokensDetails
• responses_types::resource::OutputTokensDetails
• responses_types::resource::ResponseError
• responses_types::resource::ResponseResource
• responses_types::resource::ResponseUsage
• responses_types::resource::SpecificFunctionChoice
• responses_types::resource::SpecificToolChoice
• streaming::BaseStreamer

Enums

• background_tasks::BackgroundTaskState
• embeddings::EmbeddingResponder
• image_generation::ImageGenerationResponder
• openai::AudioResponseFormat
• openai::EmbeddingEncodingFormat
• openai::EmbeddingInput
• openai::EmbeddingVector
• openai::Grammar
• openai::ResponseFormat
• openai::ResponsesMessages
• openai::StopTokens
• responses::IncludeOption
• responses::OpenResponsesInput
• responses::OpenResponsesStreamEvent
• responses::ReasoningSummary
• responses::TextFormat
• responses_types::content::Annotation
• responses_types::content::InputContent
• responses_types::content::NormalizedInputContent
• responses_types::content::OpenAIInputContent
• responses_types::content::OpenResponsesInputContent
• responses_types::content::OutputContent
• responses_types::enums::ImageDetail
• responses_types::enums::IncompleteReason
• responses_types::enums::ItemStatus
• responses_types::enums::MessageRole
• responses_types::enums::ReasoningEffort
• responses_types::enums::ResponseStatus
• responses_types::enums::ServiceTier
• responses_types::enums::TruncationStrategy
• responses_types::events::OutputItemType
• responses_types::events::StreamingEvent
• responses_types::items::InputItem
• responses_types::items::MessageContentParam
• responses_types::items::OutputItem
• responses_types::items::ResponsesInput
• responses_types::items::TaggedInputItem
• responses_types::resource::ResponseTool
• responses_types::resource::ResponseToolChoice
• responses_types::resource::SimpleToolChoice
• speech_generation::SpeechGenerationResponder
• streaming::DoneState

Traits

• cached_responses::ResponseCache

Functions

• background_tasks::get_background_task_manager
• cached_responses::get_response_cache
• chat_completion::chatcompletions
• chat_completion::create_streamer
• chat_completion::handle_error
• chat_completion::match_responses
• chat_completion::parse_request
• chat_completion::process_non_streaming_response
• completions::completions
• completions::create_streamer
• completions::handle_error
• completions::match_responses
• completions::parse_request
• completions::process_non_streaming_response
• embeddings::embeddings
• handler_core::create_response_channel
• handler_core::send_request
• handler_core::send_request_with_model
• image_generation::handle_error
• image_generation::image_generation
• image_generation::match_responses
• image_generation::parse_request
• image_generation::process_non_streaming_response
• mistralrs_for_server_builder::configure_paged_attn_from_flags
• mistralrs_for_server_builder::get_search_embedding_model
• openapi_doc::get_openapi_doc
• responses::cancel_response
• responses::create_response
• responses::delete_response
• responses::get_response
• speech_generation::handle_error
• speech_generation::match_responses
• speech_generation::parse_request
• speech_generation::process_non_streaming_response
• speech_generation::speech_generation
• streaming::get_keep_alive_interval
• util::parse_audio_url
• util::parse_image_url
• util::sanitize_error_message
• util::validate_model_name

Type Aliases

• chat_completion::ChatCompletionOnChunkCallback
• chat_completion::ChatCompletionOnDoneCallback
• chat_completion::ChatCompletionResponder
• chat_completion::ChatCompletionStreamer
• completions::CompletionOnChunkCallback
• completions::CompletionOnDoneCallback
• completions::CompletionResponder
• completions::CompletionStreamer
• responses::OpenResponsesResponder
• types::ExtractedMistralRsState
• types::OnChunkCallback
• types::OnDoneCallback
• types::SharedMistralRsState

Statics

• cached_responses::RESPONSE_CACHE

Constants

• handler_core::DEFAULT_CHANNEL_BUFFER_SIZE
• mistralrs_for_server_builder::defaults::CHAT_TEMPLATE
• mistralrs_for_server_builder::defaults::CPU
• mistralrs_for_server_builder::defaults::DEVICE
• mistralrs_for_server_builder::defaults::ENABLE_SEARCH
• mistralrs_for_server_builder::defaults::INTERACTIVE_MODE
• mistralrs_for_server_builder::defaults::IN_SITU_QUANT
• mistralrs_for_server_builder::defaults::JINJA_EXPLICIT
• mistralrs_for_server_builder::defaults::LOG
• mistralrs_for_server_builder::defaults::MAX_SEQS
• mistralrs_for_server_builder::defaults::MODEL
• mistralrs_for_server_builder::defaults::NO_KV_CACHE
• mistralrs_for_server_builder::defaults::NUM_DEVICE_LAYERS
• mistralrs_for_server_builder::defaults::PAGED_ATTN
• mistralrs_for_server_builder::defaults::PAGED_ATTN_BLOCK_SIZE
• mistralrs_for_server_builder::defaults::PAGED_ATTN_CPU
• mistralrs_for_server_builder::defaults::PAGED_ATTN_CUDA
• mistralrs_for_server_builder::defaults::PAGED_ATTN_GPU_MEM
• mistralrs_for_server_builder::defaults::PAGED_ATTN_GPU_MEM_USAGE
• mistralrs_for_server_builder::defaults::PAGED_ATTN_METAL
• mistralrs_for_server_builder::defaults::PAGED_CACHE_TYPE
• mistralrs_for_server_builder::defaults::PAGED_CTXT_LEN
• mistralrs_for_server_builder::defaults::PREFIX_CACHE_N
• mistralrs_for_server_builder::defaults::SEARCH_CALLBACK
• mistralrs_for_server_builder::defaults::SEARCH_EMBEDDING_MODEL
• mistralrs_for_server_builder::defaults::SEED
• mistralrs_for_server_builder::defaults::TOKEN_SOURCE
• mistralrs_server_router_builder::DEFAULT_MAX_BODY_LIMIT
• streaming::DEFAULT_KEEP_ALIVE_INTERVAL_MS