Struct LLGuidanceOptions

pub struct LLGuidanceOptions {
    pub no_forcing: bool,
    pub allow_invalid_utf8: bool,
}

In lark syntax, this can be specified as JSON object after ‘%llguidance’ declaration in the grammar.

Fields

no_forcing: bool

Normally, when a sequence of bytes is forced by grammar, it is tokenized canonically and forced as tokens. With no_forcing, we let the model decide on tokenization. This generally reduces both quality and speed, so should not be used outside of testing.

allow_invalid_utf8: bool

If set, the grammar will allow invalid utf8 byte sequences. Any Unicode regex will cause an error.

Implementations

impl LLGuidanceOptions

pub fn apply(&mut self, other: &LLGuidanceOptions)

Trait Implementations

impl Clone for LLGuidanceOptions

fn clone(&self) -> LLGuidanceOptions

Returns a copy of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for LLGuidanceOptions

fn fmt(&self, f: &mut Formatter<'_>) -> Result<(), Error>

Formats the value using the given formatter.

impl Default for LLGuidanceOptions

fn default() -> LLGuidanceOptions

Returns the “default value” for a type.

impl<'de> Deserialize<'de> for LLGuidanceOptions

fn deserialize<__D>( __deserializer: __D, ) -> Result<LLGuidanceOptions, <__D as Deserializer<'de>>::Error>

where __D: Deserializer<'de>,

Deserialize this value from the given Serde deserializer.

impl Serialize for LLGuidanceOptions

fn serialize<__S>( &self, __serializer: __S, ) -> Result<<__S as Serializer>::Ok, <__S as Serializer>::Error>

where __S: Serializer,

Serialize this value into the given Serde serializer.