Skip to content

mistralrs uqff

Inspect, report, or verify UQFF artifacts

mistralrs uqff [OPTIONS] <COMMAND>

Print or write a UQFF report

mistralrs uqff report [OPTIONS] --model-id <MODEL_ID>
OptionDefaultDescription
-m, --model-id <MODEL_ID>requiredHugging Face model ID or local path containing UQFF files
--quant <QUANT>Quant group to inspect, such as 3, q3k, afq3, or all
--revision <REVISION>Hugging Face revision to use
--writefalseWrite uqff_report.json beside the artifacts
--jsonfalsePrint JSON instead of human-readable text
--base-model <BASE_MODEL>Base model ID to include in a written report
--repo-id <REPO_ID>Hugging Face repo ID to include in a written report

Validate UQFF artifact structure

mistralrs uqff verify [OPTIONS] --model-id <MODEL_ID>
OptionDefaultDescription
-m, --model-id <MODEL_ID>requiredHugging Face model ID or local path containing UQFF files
--quant <QUANT>Quant group to inspect, such as 3, q3k, afq3, or all
--revision <REVISION>Hugging Face revision to use
--jsonfalsePrint JSON instead of human-readable text
--strictfalseFail on missing report/producer metadata or fallback layers
--allow-newer-minorfalseAllow same-major UQFF files with a newer minor version

Open a UQFF-aware tensor explorer

mistralrs uqff inspect [OPTIONS] --model-id <MODEL_ID>
OptionDefaultDescription
-m, --model-id <MODEL_ID>requiredHugging Face model ID or local path containing UQFF files
--quant <QUANT>Quant group to inspect, such as 3, q3k, afq3, or all
--revision <REVISION>Hugging Face revision to use