Crate toktrie

Modules

• bytes
• recognizer
• rng

Structs

• Branch
• InferenceCapabilities
  Defines what is allowed in Branch
• SimpleVob
• SimpleVobIter
• Splice
  Describes what to do after sampling.
• StepArg
• TokEnvWithTrie
• TokRxInfo
• TokTrie
• TrieNode

Enums

• SpecialToken

Traits

• Recognizer
• TokenizerEnv

Type Aliases

• StepResult
• TokEnv
• TokenId