Open bookandlover opened 1 month ago
报错如下 (.venv) (base) pengxiong@PENGMacPro llama.cpp % python3 ./convert_hf_to_gguf.py ./Unichat-llama3-Chinese-70B --vocab-only --outfile ./Unichat-llama3-Chinese-70B-_F32.gguf INFO:hf-to-gguf:Loading model: Unichat-llama3-Chinese-70B ERROR:hf-to-gguf:Model LLaMAForCausalLM is not supported 新的convert_hf_to_gguf.py 取代了之前的convert.py，参数也有些改变。很想测试70b gguf的效果，请成功转出的朋友指正
报错如下 (.venv) (base) pengxiong@PENGMacPro llama.cpp % python3 ./convert_hf_to_gguf.py ./Unichat-llama3-Chinese-70B --vocab-only --outfile ./Unichat-llama3-Chinese-70B-_F32.gguf INFO:hf-to-gguf:Loading model: Unichat-llama3-Chinese-70B ERROR:hf-to-gguf:Model LLaMAForCausalLM is not supported 新的convert_hf_to_gguf.py 取代了之前的convert.py，参数也有些改变。很想测试70b gguf的效果，请成功转出的朋友指正