mistralrs::llguidance::ffi

Function llg_commit_token

pub extern "C" fn llg_commit_token(
    cc: &mut LlgConstraint,
    token: u32,
    res_p: *mut LlgCommitResult,
) -> i32
Expand description

Commit the token sampled with the mask returned from llg_compute_mask(). Can be run on the critical path of sampling (is fast). Returns 0 on success and -1 on error (use llg_get_error() to get the exact error). When 0 is returned, the result is written to *res_p.