search

FailSpy / safetensors-wrapper

A lightweight Python wrapper for efficiently managing and loading tensors from Safetensors files
MIT License
1 stars 0 forks source link

Editing, merging, and chunking #1

Open FailSpy opened 2 months ago

FailSpy commented 2 months ago

Would be useful to have the ability to remap and write a SafeTensorWrapper into single or multiple safetensor files.

With parameters: parts OR max_file_size

If neither is defined, write to single file.

FailSpy commented 2 months ago

Might be good to have ordering sensitivity (preserve order when writing)