Module layers

Structs

• AvgPool2d
• CausalMasker
• Conv3dConfig
• Conv3dNoBias
• DeepSeekV2RopeConfig
• DeepSeekV2RotaryEmbedding
• F32RmsNorm
• FloatInfo
• Llama3RopeConfig
• Llama3RotaryEmbedding
  RoPE for Llama3
• MatMul
  Device/configurable intelligent matrix multiplication
• Mlp
• Phi4MMRopeScalingConfig
• Phi4MMRotaryEmbedding
• PhiRopeConfig
• PhiRotaryEmbedding
  RoPE supporting LongRope
• QLinear
• QRmsNorm
• Qwen2VLRotaryEmbedding
• ReflectionPad2d
  Applies 2D reflection padding to a tensor of shape (N, C, H, W).
• RmsNorm
• RotaryEmbedding
• Sdpa

Enums

• Activation
• DeepSeekV2RopeScaling
• Llama3RopeType
• Phi4MMScaledRopeType
• PhiRopeScalingConfig
• ScaledRopeType

Traits

• GetFloatInfo
• TensorInfExtend

Functions

• clamp_for_f16
• conv2d
• conv2d_no_bias
• embedding
• group_norm
• layer_norm
• linear
• linear_b
• linear_no_bias
• repeat_kv