substratusai / images

Official Substratus Container Images
1 stars 0 forks source link

model-loader-huggingface: Prevent downloading both safe tensors and pytorch model #20

Closed samos123 closed 1 year ago

samos123 commented 1 year ago

It's a waste of storage space to download both the safe tensors model and the pytorch pickle model.

For example llama2 model contains both: https://huggingface.co/meta-llama/Llama-2-7b-hf/tree/main