Enum ModelSource

pub enum ModelSource {
    ModelId(String),
    ModelIdWithTransformer {
        model_id: String,
        transformer_model_id: String,
    },
    Dduf {
        file: Cursor<Mmap>,
        name: String,
    },
}

Source from which to load the model. This is easiest to create with the various constructor functions.

Variants

ModelId(String)

ModelIdWithTransformer

Fields

model_id: String

transformer_model_id: String

Dduf

Fields

file: Cursor<Mmap>

name: String

Implementations

impl ModelSource

pub fn from_model_id<S>(model_id: S) -> ModelSource

where S: ToString,

Load the model from a Hugging Face model ID or a local path.

pub fn override_transformer_model_id<S>( self, model_id: S, ) -> Result<ModelSource, Error>

where S: ToString,

Load the transformer part of this model from a Hugging Face model ID or a local path.

For example, this enables loading a quantized transformer model (for instance, this) with the same base model as the original model ID.

use diffusion_rs_common::ModelSource;

let _ = ModelSource::from_model_id("black-forest-labs/FLUX.1-dev")
    .override_transformer_model_id("sayakpaul/flux.1-dev-nf4-with-bnb-integration")?;

pub fn dduf<S>(filename: S) -> Result<ModelSource, Error>

where S: ToString,

Load a DDUF model from a .dduf file.

Trait Implementations

impl Display for ModelSource

fn fmt(&self, f: &mut Formatter<'_>) -> Result<(), Error>

Formats the value using the given formatter.