Function llg_free_tokenizer
pub extern "C" fn llg_free_tokenizer(tok: *mut LlgTokenizer)
Expand description
Free the tokenizer. Should NOT be called while there are still constraints using it.
pub extern "C" fn llg_free_tokenizer(tok: *mut LlgTokenizer)
Free the tokenizer. Should NOT be called while there are still constraints using it.