MAX_GEMV_BATCH_SIZE

mistralrs_quant::gemv

Constant MAX_GEMV_BATCH_SIZE 

Source 
pub const MAX_GEMV_BATCH_SIZE: usize = 8;
Expand description

Maximum batch size supported by the GEMV kernel