Function llg_stringify_tokens 

#[unsafe(no_mangle)]
pub unsafe extern "C" fn llg_stringify_tokens(
    tok: &LlgTokenizer,
    tokens: *const u32,
    n_tokens: usize,
    output: *mut i8,
    output_len: usize,
) -> usize

Return a string representation of the tokens, useful for debugging. The output is NUL-terminated. Returns the number of bytes that would be written to output if output_len was large enough.

Safety

This function should only be called from C code.