Function llg_decode_tokens

pub unsafe extern "C" fn llg_decode_tokens(
    tok: &LlgTokenizer,
    tokens: *const u32,
    n_tokens: usize,
    output: *mut i8,
    output_len: usize,
    flags: u32,
) -> usize

Return a string representation of the tokens, useful for debugging. The output is NUL-terminated. Returns the number of bytes that would be written to output if output_len was large enough. flags is one of LLG_DECODE_*

Safety

This function should only be called from C code.