CalculatedContent / WeightWatcher

The WeightWatcher tool for predicting the accuracy of Deep Neural Networks
Apache License 2.0
1.47k stars 125 forks source link

Add support for safetensors format #262

Closed charlesmartin14 closed 1 year ago

charlesmartin14 commented 1 year ago

Huggingface Safetensors is a replacement for the pytorch state_dict binary file format

Reading such files is much faster than reading pytorch_model.bin files We should add support for this to process models like

https://huggingface.co/camelids/llama-13b-fp16-safetensors