Struct GenOptions

pub struct GenOptions {
    pub body_rx: RegexAst,
    pub stop_rx: RegexAst,
    pub stop_capture_name: Option<String>,
    pub lazy: Option<bool>,
    pub is_suffix: Option<bool>,
    pub temperature: Option<f32>,
}

Fields

body_rx: RegexAst

Regular expression matching the body of generation.

stop_rx: RegexAst

The whole generation must match body_rx + stop_rx. Whatever matched stop_rx is discarded. If stop_rx is empty, it’s assumed to be EOS.

stop_capture_name: Option<String>

When set, the string matching stop_rx will be output as a capture with the given name.

lazy: Option<bool>

Lazy gen()s take the shortest match. Non-lazy take the longest. If not specified, the gen() is lazy if stop_rx is non-empty.

is_suffix: Option<bool>

Treat stop_rx as suffix, i.e., do not hide it from the LLM (but do not include it in the capture).

temperature: Option<f32>

Override sampling temperature.

Trait Implementations

impl Clone for GenOptions

fn clone(&self) -> GenOptions

Returns a copy of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.