unslothai / unsloth

Finetune Llama 3, Mistral, Phi & Gemma LLMs 2-5x faster with 80% less memory
https://unsloth.ai
Apache License 2.0
12.19k stars 792 forks source link

Storing models to huggingface is not working #636

Open MaheshAwasare opened 2 weeks ago

MaheshAwasare commented 2 weeks ago

Hello,

I think instructions for storing model to hugging face are not very clear.

Following line in notebook tries to push model to HF model repository

("hf/model", tokenizer, quantization_method = "f16", token = "TOKEN")

When I put token here it gives me following error

`Unsloth: Conversion completed! Output location: ./hf/model-unsloth.F16.gguf Unsloth: Uploading GGUF to Huggingface Hub...

HTTPError Traceback (most recent call last) /usr/local/lib/python3.10/dist-packages/huggingface_hub/utils/_errors.py in hf_raise_for_status(response, endpoint_name) 303 try: --> 304 response.raise_for_status() 305 except HTTPError as e:

13 frames HTTPError: 404 Client Error: Not Found for url: https://huggingface.co/api/models/hf/model/preupload/main

The above exception was the direct cause of the following exception:

RepositoryNotFoundError Traceback (most recent call last) /usr/local/lib/python3.10/dist-packages/huggingface_hub/utils/_errors.py in hf_raise_for_status(response, endpoint_name) 350 " make sure you are authenticated." 351 ) --> 352 raise RepositoryNotFoundError(message, response) from e 353 354 elif response.status_code == 400:

RepositoryNotFoundError: 404 Client Error. (Request ID: Root=1-666bad05-2889757b73cbfc3117c15478;ac3e632d-c04e-432a-b8aa-f0091dd477f7)

Repository Not Found for url: https://huggingface.co/api/models/hf/model/preupload/main. Please make sure you specified the correct repo_id and repo_type. If you are trying to access a private or gated repo, make sure you are authenticated. Note: Creating a commit assumes that the repo already exists on the Huggingface Hub. Please use create_repo if it's not the case.`

Do we need to create any repo for this? If yes, wouldn't it be easy to have this optional step inside notebook where it will call create_Repo?

Not sure where in the notebook I am advised to create the repo.

Can you please tell me what is exact procedure to push model to HF?

danielhanchen commented 2 weeks ago

You need to change "hf/model" to your HF username like "unsloth/model"