search

containers / ai-lab-recipes

Examples for building and running LLM services and applications locally with Podman
Apache License 2.0
100 stars 103 forks source link

Update the convert_models/run.sh #724

Open melodyliu1986 opened 1 month ago

melodyliu1986 commented 1 month ago

I want to convert the huggingface models to gguf file, but always met errors when following the README.md, then I found the files in llama.cpp repo are updated:

python download_huggingface.py --model $hf_model_url --> this should be converted_models/download_huggingface.py python llama.cpp/convert.py /opt/app-root/src/converter/converted_models/$hf_model_url -> there is no convert.py in https://github.com/ggerganov/llama.cpp python llama.cpp/convert-hf-to-gguf.py /opt/app-root/src/converter/converted_models/$hf_model_url -> llama.cpp/convert-hf-to-gguf.py should be llama.cpp/convert_hf_to_gguf.py now

Can you fix the problem and let me try again?

rhatdan commented 1 month ago

Care to open a PR?

melodyliu1986 commented 1 month ago

Care to open a PR? Sure, please review it https://github.com/containers/ai-lab-recipes/pull/741