Struct MistralRs

pub struct MistralRs { /* private fields */ }

The MistralRs struct handles sending requests to the engine. It is the core multi-threaded component of mistral.rs, and uses mpsc Sender and Receiver primitives to send and receive requests to the engine.

Implementations

impl MistralRs

pub fn get_sender(&self) -> Result<Sender<Request>, MistralRsError>

pub fn get_id(&self) -> String

pub fn get_creation_time(&self) -> u64

pub fn get_model_category(&self) -> ModelCategory

pub fn next_request_id(&self) -> usize

pub fn maybe_log_request(this: Arc<Self>, repr: String)

pub fn maybe_log_response<T: Serialize>(this: Arc<Self>, resp: &T)

pub fn maybe_log_error(this: Arc<Self>, err: &dyn Error)

pub fn config(&self) -> &MistralRsConfig

Trait Implementations

impl Drop for MistralRs

fn drop(&mut self)

Executes the destructor for this type.