diffusion_rs_common::nn

Module init

source
Expand description

Variable initialization.

Enums§

  • FanInOut
    Number of features as input or output of a layer. In Kaiming initialization, choosing FanIn preserves the magnitude of the variance of the weights in the forward pass, choosing FanOut preserves this magnitude in the backward pass.
  • Init
    Variable initializations.
  • NonLinearity
    The non-linear function that follows this layer. ReLU is the recommended value.
  • NormalOrUniform

Constants§