Module layers

Structs

• CausalMasker
• Conv3dConfig
• Conv3dNoBias
• DeepSeekV2RopeConfig
• DeepSeekV2RotaryEmbedding
• F32RmsNorm
• FloatInfo
• Llama3RopeConfig
• Llama3RotaryEmbedding
  RoPE for Llama3
• MatMul
  Device/configurable intelligent matrix multiplication
• PhiRopeConfig
• PhiRotaryEmbedding
  RoPE supporting LongRope
• QLinear
• QRmsNorm
• Qwen2VLRotaryEmbedding
• RmsNorm
• RotaryEmbedding
• Sdpa

Enums

• Activation
• DeepSeekV2RopeScaling
• Llama3RopeType
• PhiRopeScalingConfig
• ScaledRopeType

Traits

• GetFloatInfo
• TensorInfExtend

Functions

• clamp_for_f16
• conv2d
• conv2d_no_bias
• embedding
• group_norm
• layer_norm
• linear
• linear_b
• linear_no_bias
• repeat_kv