List of all items

Structs

• AddModelConfig
• AnyMoeConfig
• AnyMoeLoader
• AnyMoeModelBuilder
• AnyMoePipeline
• ApproximateUserLocation
• AudioInput
• AutoLoader
• AutoLoaderBuilder
• CalledFunction
• ChatCompletionChunkResponse
• ChatCompletionResponse
• ChatTemplate
• Choice
• ChunkChoice
• CompletionChoice
• CompletionChunkChoice
• CompletionChunkResponse
• CompletionResponse
• Delta
• DetokenizationRequest
• DeviceLayerMapMetadata
• DeviceMapMetadata
• DiffusionGenerationParams
• DiffusionLoader
• DiffusionLoaderBuilder
• DiffusionModelBuilder
• DrySamplingParams
• EmbeddingLoader
• EmbeddingLoaderBuilder
• EmbeddingModelBuilder
• EmbeddingModelPaths
• EmbeddingRequest
• EmbeddingRequestBuilder
• EmbeddingSpecificConfig
• EngineConfig
• Function
• GGMLLoader
• GGMLLoaderBuilder
• GGMLSpecificConfig
• GGUFLoader
• GGUFLoaderBuilder
• GGUFSpecificConfig
• GemmaLoader
• GgufLoraModelBuilder
• GgufModelBuilder
• GgufXLoraModelBuilder
• Idefics2Loader
• ImageChoice
• ImageGenerationResponse
• LLaVALoader
• LLaVANextLoader
• LayerDeviceMapper
• LayerTopology
• LlamaLoader
• LoaderBuilder
• LocalModelPaths
• Logprobs
• LoraAdapterPaths
• LoraModelBuilder
• McpClient
• McpClientConfig
• McpServerConfig
• McpToolInfo
• MemoryUsage
• MistralLoader
• MistralRs
• MistralRsBuilder
• MistralRsConfig
• MixtralLoader
• Modalities
• Model
• MultiModel
• NormalLoader
• NormalLoaderBuilder
• NormalRequest
• NormalSpecificConfig
• Ordering
• PagedAttentionConfig
• PagedAttentionMetaBuilder
• Phi2Loader
• Phi3Loader
• Phi3VLoader
• Qwen2Loader
• RequestBuilder
• ResponseLogprob
• ResponseMessage
• SamplingParams
• SearchFunctionParameters
• SearchResult
• SpeculativeConfig
• SpeculativeLoader
• SpeculativePipeline
• SpeechLoader
• SpeechModelBuilder
• SpeechPipeline
• Starcoder2Loader
• Tensor
• TextMessages
• TextModelBuilder
• TextSpeculativeBuilder
• TokenizationRequest
• Tool
• ToolCallResponse
• ToolCallbackWithTool
• TopLogprob
• Topology
• UqffEmbeddingModelBuilder
• UqffTextModelBuilder
• UqffVisionModelBuilder
• Usage
• VisionLoader
• VisionLoaderBuilder
• VisionMessages
• VisionModelBuilder
• VisionSpecificConfig
• WebSearchOptions
• XLoraModelBuilder
• layers::AvgPool2d
• layers::CausalMasker
• layers::Conv3dConfig
• layers::Conv3dNoBias
• layers::DeepSeekV2RopeConfig
• layers::DeepSeekV2RotaryEmbedding
• layers::DiaRotaryEmbedding
• layers::F32RmsNorm
• layers::FloatInfo
• layers::Gemma3RopeScalingConfig
• layers::Gemma3RotaryEmbedding
• layers::Gemma3nRopeScalingConfig
• layers::Gemma3nRotaryEmbedding
• layers::Llama3RopeConfig
• layers::Llama3RotaryEmbedding
• layers::MatMul
• layers::Mlp
• layers::Phi4MMRopeScalingConfig
• layers::Phi4MMRotaryEmbedding
• layers::PhiRopeConfig
• layers::PhiRotaryEmbedding
• layers::QLinear
• layers::QRmsNorm
• layers::Qwen2VLRotaryEmbedding
• layers::Qwen2_5VLRotaryEmbedding
• layers::Qwen3VLRotaryEmbedding
• layers::ReflectionPad2d
• layers::RmsNorm
• layers::RotaryEmbedding
• layers::ScaledEmbedding
• layers::Sdpa
• layers::SmolLm3RopeConfig
• layers::SmolLm3RotaryEmbedding
• llguidance::CommitResult
• llguidance::Constraint
• llguidance::GrammarBuilder
• llguidance::Instant
• llguidance::JsonCompileOptions
• llguidance::Logger
• llguidance::Matcher
• llguidance::NodeRef
• llguidance::ParserFactory
• llguidance::StopController
• llguidance::TokenParser
• llguidance::api::GenGrammarOptions
• llguidance::api::GenOptions
• llguidance::api::GrammarWithLexer
• llguidance::api::LLGuidanceOptions
• llguidance::api::NodeProps
• llguidance::api::ParserLimits
• llguidance::api::RegexExt
• llguidance::api::TopLevelGrammar
• llguidance::derivre::AlphabetInfo
• llguidance::derivre::ExprRef
• llguidance::derivre::JsonQuoteOptions
• llguidance::derivre::Regex
• llguidance::derivre::RegexBuilder
• llguidance::derivre::StateID
• llguidance::derivre::raw::DerivCache
• llguidance::derivre::raw::ExprSet
• llguidance::derivre::raw::NextByteCache
• llguidance::derivre::raw::RelevanceCache
• llguidance::derivre::raw::VecHashCons
• llguidance::earley::CGrammar
• llguidance::earley::CSymIdx
• llguidance::earley::Grammar
• llguidance::earley::ParamRef
• llguidance::earley::ParamValue
• llguidance::earley::Parser
• llguidance::earley::ParserMetrics
• llguidance::earley::ParserRecognizer
• llguidance::earley::ParserStats
• llguidance::earley::SlicedBiasComputer
• llguidance::earley::SymIdx
• llguidance::earley::SymbolProps
• llguidance::earley::XorShift
• llguidance::earley::lexerspec::Lexeme
• llguidance::earley::lexerspec::LexemeClass
• llguidance::earley::lexerspec::LexemeIdx
• llguidance::earley::lexerspec::LexemeSpec
• llguidance::earley::lexerspec::LexerSpec
• llguidance::earley::perf::ParserPerfCounters
• llguidance::earley::perf::PerfTimer
• llguidance::earley::regexvec::AlphabetInfo
• llguidance::earley::regexvec::ExprRef
• llguidance::earley::regexvec::LexemeSet
• llguidance::earley::regexvec::LexerStats
• llguidance::earley::regexvec::RegexVec
• llguidance::earley::regexvec::StateDesc
• llguidance::earley::regexvec::StateID
• llguidance::ffi::LlgCommitResult
• llguidance::ffi::LlgConstraint
• llguidance::ffi::LlgConstraintInit
• llguidance::ffi::LlgConstraintStep
• llguidance::ffi::LlgMaskResult
• llguidance::ffi::LlgMatcher
• llguidance::ffi::LlgStopController
• llguidance::ffi::LlgTokenizer
• llguidance::ffi::LlgTokenizerInit
• llguidance::output::BytesOutput
• llguidance::output::ParserStats
• llguidance::output::Reporter
• llguidance::toktrie::AnythingGoes
• llguidance::toktrie::ApproximateTokEnv
• llguidance::toktrie::Branch
• llguidance::toktrie::InferenceCapabilities
• llguidance::toktrie::SimpleVob
• llguidance::toktrie::SimpleVobIter
• llguidance::toktrie::Splice
• llguidance::toktrie::StepArg
• llguidance::toktrie::TokEnvWithTrie
• llguidance::toktrie::TokRxInfo
• llguidance::toktrie::TokTrie
• llguidance::toktrie::TrieNode
• llguidance::toktrie::bytes::U32Pair
• llguidance::toktrie::recognizer::AnythingGoes
• llguidance::toktrie::recognizer::StackRecognizer
• llguidance::toktrie::rng::Rng
• matformer::MatformerConfig
• matformer::MatformerSliceConfig
• matformer::Slice

Enums

• AdapterPaths
• AnyMoeExpertType
• AutoDeviceMapParams
• BertEmbeddingModel
• Constraint
• DType
• DefaultSchedulerMethod
• Device
• DeviceMapSetting
• DiffusionLoaderType
• EmbeddingLoaderType
• EmbeddingRequestInput
• EngineInstruction
• GGUFArchitecture
• ImageGenerationResponseFormat
• IsqOrganization
• IsqType
• McpServerSource
• MemoryGpuConfig
• MistralRsError
• ModelCategory
• ModelDType
• ModelKind
• ModelSelected
• NormalLoaderType
• PagedCacheType
• Request
• RequestMessage
• Response
• ResponseErr
• ResponseOk
• SchedulerConfig
• SearchContextSize
• SpeechGenerationConfig
• SpeechLoaderType
• StopTokens
• SupportedModality
• TextMessageRole
• TokenSource
• ToolCallType
• ToolChoice
• ToolType
• VisionLoaderType
• WebSearchUserLocation
• layers::Activation
• layers::DeepSeekV2RopeScaling
• layers::Gemma3ScaledRopeType
• layers::Gemma3nScaledRopeType
• layers::Llama3RopeType
• layers::Phi4MMScaledRopeType
• layers::PhiRopeScalingConfig
• layers::ScaledRopeType
• layers::SmolLm3RopeType
• llguidance::api::GrammarId
• llguidance::api::GrammarInit
• llguidance::api::StopReason
• llguidance::api::ValidationResult
• llguidance::derivre::NextByte
• llguidance::derivre::RegexAst
• llguidance::earley::ParamCond
• llguidance::earley::ParamExpr
• llguidance::earley::ParserError
• llguidance::earley::ValidationResult
• llguidance::earley::regexvec::MatchingLexemes
• llguidance::earley::regexvec::NextByte
• llguidance::output::ParserOutput

Traits

• CustomLogitsProcessor
• Loader
• ModelPaths
• MultimodalPromptPrefixer
• Pipeline
• RequestLike
• TryIntoDType
• layers::GetFloatInfo
• layers::TensorInfExtend
• llguidance::earley::BiasComputer
• llguidance::toktrie::Recognizer
• llguidance::toktrie::TokenizerEnv
• llguidance::toktrie::recognizer::FunctionalRecognizer
• speech_utils::Sample

Macros

• llguidance::id32_type
• llguidance::infoln
• llguidance::loginfo
• llguidance::warn

Functions

• best_device
• cross_entropy_loss
• distributed::is_daemon
• distributed::nccl_daemon_replicator
• distributed::ring_daemon_replicator
• distributed::use_nccl
• get_auto_device_map_params
• get_engine_terminate_flag
• get_model_dtype
• get_tgt_non_granular_index
• get_toml_selected_model_device_map_params
• get_toml_selected_model_dtype
• initialize_logging
• layers::batch_norm
• layers::clamp_for_f16
• layers::conv1d
• layers::conv1d_no_bias
• layers::conv2d
• layers::conv2d_no_bias
• layers::embedding
• layers::group_norm
• layers::layer_norm
• layers::linear
• layers::linear_b
• layers::linear_no_bias
• layers::repeat_kv
• llguidance::derivre::map_ast
• llguidance::earley::lexerspec::token_ranges_to_string
• llguidance::earley::perf::num_with_commas
• llguidance::ffi::constraint_to_llg
• llguidance::ffi::llg_clone_constraint
• llguidance::ffi::llg_clone_matcher
• llguidance::ffi::llg_clone_stop_controller
• llguidance::ffi::llg_clone_tokenizer
• llguidance::ffi::llg_commit_token
• llguidance::ffi::llg_compute_mask
• llguidance::ffi::llg_constraint_init_set_defaults
• llguidance::ffi::llg_decode_tokens
• llguidance::ffi::llg_flush_logs
• llguidance::ffi::llg_free_constraint
• llguidance::ffi::llg_free_matcher
• llguidance::ffi::llg_free_stop_controller
• llguidance::ffi::llg_free_tokenizer
• llguidance::ffi::llg_get_error
• llguidance::ffi::llg_get_temperature
• llguidance::ffi::llg_is_stopped
• llguidance::ffi::llg_matcher_compute_ff_tokens
• llguidance::ffi::llg_matcher_compute_mask
• llguidance::ffi::llg_matcher_compute_mask_into
• llguidance::ffi::llg_matcher_consume_token
• llguidance::ffi::llg_matcher_consume_tokens
• llguidance::ffi::llg_matcher_get_error
• llguidance::ffi::llg_matcher_get_mask
• llguidance::ffi::llg_matcher_get_mask_byte_size
• llguidance::ffi::llg_matcher_is_accepting
• llguidance::ffi::llg_matcher_is_error
• llguidance::ffi::llg_matcher_is_stopped
• llguidance::ffi::llg_matcher_reset
• llguidance::ffi::llg_matcher_rollback
• llguidance::ffi::llg_matcher_validate_tokens
• llguidance::ffi::llg_new_constraint
• llguidance::ffi::llg_new_constraint_any
• llguidance::ffi::llg_new_constraint_json
• llguidance::ffi::llg_new_constraint_lark
• llguidance::ffi::llg_new_constraint_regex
• llguidance::ffi::llg_new_matcher
• llguidance::ffi::llg_new_stop_controller
• llguidance::ffi::llg_new_tokenizer
• llguidance::ffi::llg_par_compute_mask
• llguidance::ffi::llg_stop_commit_token
• llguidance::ffi::llg_stringify_tokens
• llguidance::ffi::llg_tokenize_bytes
• llguidance::ffi::llg_tokenize_bytes_marker
• llguidance::ffi::llg_validate_grammar
• llguidance::ffi::save_error_string
• llguidance::json_merge
• llguidance::panic_utils::catch_unwind
• llguidance::panic_utils::mk_panic_error
• llguidance::regex_to_lark
• llguidance::substring::chunk_into_chars
• llguidance::substring::chunk_into_words
• llguidance::substring::substring
• llguidance::token_bytes_from_tokenizer_json
• llguidance::toktrie::bytes::clone_vec_as_bytes
• llguidance::toktrie::bytes::from_hex_string
• llguidance::toktrie::bytes::limit_bytes
• llguidance::toktrie::bytes::limit_display
• llguidance::toktrie::bytes::limit_str
• llguidance::toktrie::bytes::to_hex_string
• llguidance::toktrie::bytes::vec_from_bytes
• llguidance::toktrie::parse_numeric_token
• paged_attn_supported
• parse_isq_value
• reset_engine_terminate_flag
• should_terminate_engine_sequences
• speech_utils::write_pcm_as_wav
• using_flash_attn

Type Aliases

• LlguidanceGrammar
• MessageContent
• Result
• SearchCallback
• ToolCallback
• ToolCallbacks
• llguidance::HashMap
• llguidance::HashSet
• llguidance::derivre::HashMap
• llguidance::derivre::HashSet
• llguidance::derivre::RandomState
• llguidance::earley::BitIdx
• llguidance::ffi::LlgCallback
• llguidance::ffi::LlgToken
• llguidance::ffi::LlgTokenizeFn
• llguidance::toktrie::StepResult
• llguidance::toktrie::TokEnv
• llguidance::toktrie::TokenId

Statics

• ENGINE_INSTRUCTIONS
• GLOBAL_HF_CACHE
• TERMINATE_ALL_NEXT_STEP

Constants

• GGUF_MULTI_FILE_DELIMITER
• MULTI_LORA_DELIMITER
• SYSTEM_FINGERPRINT
• UQFF_MULTI_FILE_DELIMITER
• llguidance::api::DEFAULT_CONTEXTUAL
• llguidance::ffi::LLG_DECODE_INCLUDE_SPECIAL
• llguidance::ffi::LLG_DECODE_NONE
• llguidance::ffi::LLG_DECODE_VALID_UTF8
• llguidance::toktrie::INVALID_TOKEN