使用CPU运行13B的模型，有2个bin文件怎么选择呢

Facico / Chinese-Vicuna

Chinese-Vicuna: A Chinese Instruction-following LLaMA-based Model —— 一个中文低资源的llama+lora方案，结构参考alpaca

https://github.com/Facico/Chinese-Vicuna

Apache License 2.0

4.14k stars 425 forks source link

Closed hengxingtx closed 1 year ago

hengxingtx commented 1 year ago

转换之后会生成两个文件: ggml-model-f16.bin ggml-model-f16.bin.1 运行的时候使用2个文件都不能成功，该怎么弄啊，请教下大家

hengxingtx commented 1 year ago

是n_parts读取错误问题，自己解决了