pub struct MatMul;Expand description
Matrix multiplication, configurable to be via f16 (to use the faster GEMM kernels) optionally.
Implementations§
source§impl MatMul
impl MatMul
sourcepub fn matmul(&self, a: &Tensor, b: &Tensor) -> Result<Tensor, Error>
pub fn matmul(&self, a: &Tensor, b: &Tensor) -> Result<Tensor, Error>
Compute matrix-matrix product, optionally casting to f16 to use specialized GEMM kernels.
sourcepub fn matmul_affine_div(
&self,
a: &Tensor,
b: &Tensor,
scale: f64,
) -> Result<Tensor, Error>
pub fn matmul_affine_div( &self, a: &Tensor, b: &Tensor, scale: f64, ) -> Result<Tensor, Error>
Compute matrix-matrix product, optionally casting to f16 to use specialized GEMM kernels.
The result will be divided by the scale parameter in an affine division.
sourcepub fn qmatmul(&self, x: &Tensor, matmul: &QMatMul) -> Result<Tensor, Error>
pub fn qmatmul(&self, x: &Tensor, matmul: &QMatMul) -> Result<Tensor, Error>
Compute quantized matrix-matrix product, optionally casting to f16 to use specialized GEMM kernels.
sourcepub fn qmethod_matmul(
&self,
x: &Tensor,
matmul: &dyn QuantMethod,
) -> Result<Tensor, Error>
pub fn qmethod_matmul( &self, x: &Tensor, matmul: &dyn QuantMethod, ) -> Result<Tensor, Error>
Compute quantized matrix-matrix product, optionally casting to f16 to use specialized GEMM kernels.
Auto Trait Implementations§
impl Freeze for MatMul
impl RefUnwindSafe for MatMul
impl Send for MatMul
impl Sync for MatMul
impl Unpin for MatMul
impl UnwindSafe for MatMul
Blanket Implementations§
source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more
§impl<T> Downcast for Twhere
T: AsAny + ?Sized,
impl<T> Downcast for Twhere
T: AsAny + ?Sized,
§fn downcast_ref<T>(&self) -> Option<&T>where
T: AsAny,
fn downcast_ref<T>(&self) -> Option<&T>where
T: AsAny,
Forward to the method defined on the type
Any.§fn downcast_mut<T>(&mut self) -> Option<&mut T>where
T: AsAny,
fn downcast_mut<T>(&mut self) -> Option<&mut T>where
T: AsAny,
Forward to the method defined on the type
Any.§impl<T> Instrument for T
impl<T> Instrument for T
§fn instrument(self, span: Span) -> Instrumented<Self>
fn instrument(self, span: Span) -> Instrumented<Self>
§fn in_current_span(self) -> Instrumented<Self>
fn in_current_span(self) -> Instrumented<Self>
source§impl<T> IntoEither for T
impl<T> IntoEither for T
source§fn into_either(self, into_left: bool) -> Either<Self, Self> ⓘ
fn into_either(self, into_left: bool) -> Either<Self, Self> ⓘ
Converts
self into a Left variant of Either<Self, Self>
if into_left is true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read moresource§fn into_either_with<F>(self, into_left: F) -> Either<Self, Self> ⓘ
fn into_either_with<F>(self, into_left: F) -> Either<Self, Self> ⓘ
Converts
self into a Left variant of Either<Self, Self>
if into_left(&self) returns true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read more