search

unslothai / unsloth

Finetune Llama 3.2, Mistral, Phi, Qwen 2.5 & Gemma LLMs 2-5x faster with 80% less memory
https://unsloth.ai
Apache License 2.0
18.69k stars 1.31k forks source link

convert-hf-to-gguf.py should have underscores. #875

Open William-Wildridge opened 3 months ago

William-Wildridge commented 3 months ago

In the wiki (https://github.com/unslothai/unsloth/wiki) for manually saving to gguf it has the line:

python llama.cpp/convert-hf-to-gguf.py FOLDER --outfile OUTPUT --outtype f16

This should be:

python llama.cpp/convert_hf_to_gguf.py FOLDER --outfile OUTPUT --outtype f16

Thanks!

danielhanchen commented 3 months ago

Oh yes!! Actually would you be interested in opening a PR and editing the Readme file, and then I'll copy paste your edits to the Wiki :)