mistralrs_quant

Function linear_no_bias_static_lora

Source 
pub fn linear_no_bias_static_lora(
    in_dim: usize,
    out_dim: usize,
    loras: HashMap<String, StaticLoraConfig>,
    vb: ShardedVarBuilder<'_>,
) -> Result<Arc<dyn QuantMethod>>
Expand description

Static LoRA in the style of Phi-4 multimodal. Only when the layer regex for the specific LoRA matches.

Structure:

  • prefix.base_layer.weight
  • prefix.lora_A..weight
  • prefix.lora_B..weight