mistralrs_server_core::chat_completion

Function create_chat_streamer

Source 
pub fn create_chat_streamer(
    rx: Receiver<Response>,
    state: SharedMistralRsState,
    on_chunk: Option<OnChunkCallback>,
    on_done: Option<OnDoneCallback>,
) -> Sse<Streamer>
Expand description

Creates a SSE streamer for chat completions with optional callbacks.