search

FourthBrain / Building-with-Instruction-Tuned-LLMs-A-Step-by-Step-Guide

Resources relating to the DLAI event: https://www.youtube.com/watch?v=eTieetk2dSw
178 stars 43 forks source link

Bug report: uploading model to Huggingface failed #1

Open zbruceli opened 1 year ago

zbruceli commented 1 year ago

Hi, after I finished training and trying to upload model to HF using command

base_model.push_to_hub("zbruceli/openLLaMA_QLora", private=True)

The following error occurred:

NotImplementedError: You are calling save_pretrained on a 4-bit converted model. This is currently not supported

Are there something I need to change when I create the model/repo on HF? Thank you!

Uploading the tokenizer works fine, so it is not a HF token issue.

chris-alexiuk-1 commented 1 year ago

Let me look into this and provide an update to the Notebook!

ka4on commented 11 months ago

same problem here, is it fixed? Thanks