mlabonne / llm-course

Course to get into Large Language Models (LLMs) with roadmaps and Colab notebooks.
https://mlabonne.github.io/blog/
Apache License 2.0
39.18k stars 4.14k forks source link

Could save the fine-tune model as saffetensors? #6

Closed elliotthwang closed 1 year ago

elliotthwang commented 1 year ago

Hi! Could save the fine-tune model as saffetensors? Thanks

mlabonne commented 1 year ago

Yes, you can use the following line to save the fine-tuned model with safetensors: model.save_quantized(out_dir, use_safetensors=True)

elliotthwang commented 1 year ago

Thanks a lot!