pub fn parse_isq_value(
s: &str,
device: Option<&Device>,
) -> Result<IsqType, String>Expand description
Parse ISQ value.
If the provided value is a valid integer (one of 2,3,4,5,6,8), the best quantization type will be chosen. Note that the fallback is always a Q/K quantization but on Metal 2,3,4,6,8 uses the fast AFQ.
One of:
Q4_0Q4_1Q5_0Q5_1Q8_0Q8_1Q2KQ3KQ4KQ5KQ6KQ8KHQQ1HQQ2HQQ3HQQ4HQQ8AFQ2AFQ3AFQ4AFQ6AFQ8