Module layers

Source

Structs§

AvgPool2d
CausalMasker
Conv3dConfig
Conv3dNoBias
DeepSeekV2RopeConfig
DeepSeekV2RotaryEmbedding
DiaRotaryEmbedding
F32RmsNorm
FloatInfo
Gemma3RopeScalingConfig
Gemma3RotaryEmbedding
Gemma3nRopeScalingConfig
Gemma3nRotaryEmbedding
Llama3RopeConfig
Llama3RotaryEmbedding
RoPE for Llama3
MatMul
Device/configurable intelligent matrix multiplication
Mlp
Phi4MMRopeScalingConfig
Phi4MMRotaryEmbedding
PhiRopeConfig
PhiRotaryEmbedding
RoPE supporting LongRope
QLinear
QRmsNorm
Qwen2VLRotaryEmbedding
Qwen2_5VLRotaryEmbedding
ReflectionPad2d
Applies 2D reflection padding to a tensor of shape (N, C, H, W).
RmsNorm
RotaryEmbedding
ScaledEmbedding
Sdpa
SmolLm3RopeConfig
SmolLm3RotaryEmbedding
RoPE for SmolLm3

Enums§

Activation
DeepSeekV2RopeScaling
Gemma3ScaledRopeType
Gemma3nScaledRopeType
Llama3RopeType
Phi4MMScaledRopeType
PhiRopeScalingConfig
ScaledRopeType
SmolLm3RopeType

Traits§

GetFloatInfo
TensorInfExtend

Functions§

batch_norm
clamp_for_f16
conv1d
conv1d_no_bias
conv2d
conv2d_no_bias
embedding
group_norm
layer_norm
linear
linear_b
linear_no_bias
repeat_kv