Struct MmapedSafetensors

pub struct MmapedSafetensors { /* private fields */ }

Implementations

impl MmapedSafetensors

pub unsafe fn new<P: AsRef<Path>>(p: P) -> Result<Self>

Creates a wrapper around a memory mapped file and deserialize the safetensors header.

Safety

The unsafe is inherited from [memmap2::MmapOptions].

pub unsafe fn multi<P: AsRef<Path>>(paths: &[P]) -> Result<Self>

Creates a wrapper around multiple memory mapped file and deserialize the safetensors headers.

If a tensor name appears in multiple files, the last entry is returned.

Safety

The unsafe is inherited from [memmap2::MmapOptions].

pub fn load(&self, name: &str, dev: &Device) -> Result<Tensor>

pub fn tensors(&self) -> Vec<(String, TensorView<'_>)>

pub fn get(&self, name: &str) -> Result<TensorView<'_>>

Trait Implementations

impl SimpleBackend for MmapedSafetensors

fn get( &self, s: Shape, name: &str, _: Init, dtype: DType, dev: &Device, ) -> Result<Tensor>

Retrieve a tensor based on a target name and shape.

fn get_unchecked( &self, name: &str, dtype: DType, dev: &Device, ) -> Result<Tensor>

Retrieve a tensor based on the name.

fn contains_tensor(&self, name: &str) -> bool