Module layers

Source

Structs§

AvgPool2d
CausalMasker
Conv3dConfig
Conv3dNoBias
DeepSeekV2RopeConfig
DeepSeekV2RotaryEmbedding
F32RmsNorm
FloatInfo
Gemma3RopeScalingConfig
Gemma3RotaryEmbedding
Llama3RopeConfig
Llama3RotaryEmbedding
RoPE for Llama3
MatMul
Device/configurable intelligent matrix multiplication
Mlp
Phi4MMRopeScalingConfig
Phi4MMRotaryEmbedding
PhiRopeConfig
PhiRotaryEmbedding
RoPE supporting LongRope
QLinear
QRmsNorm
Qwen2VLRotaryEmbedding
Qwen2_5VLRotaryEmbedding
ReflectionPad2d
Applies 2D reflection padding to a tensor of shape (N, C, H, W).
RmsNorm
RotaryEmbedding
ScaledEmbedding
Sdpa

Enums§

Activation
DeepSeekV2RopeScaling
Gemmma3ScaledRopeType
Llama3RopeType
Phi4MMScaledRopeType
PhiRopeScalingConfig
ScaledRopeType

Traits§

GetFloatInfo
TensorInfExtend

Functions§

clamp_for_f16
conv2d
conv2d_no_bias
embedding
group_norm
layer_norm
linear
linear_b
linear_no_bias
repeat_kv