运行bash scripts/generate.sh或者bash scripts/chat_7B.sh后一般多久就可以进行推理了

Facico / Chinese-Vicuna

Chinese-Vicuna: A Chinese Instruction-following LLaMA-based Model —— 一个中文低资源的llama+lora方案，结构参考alpaca

https://github.com/Facico/Chinese-Vicuna

Apache License 2.0

4.14k stars 425 forks source link

Closed Junglesl closed 1 year ago

Junglesl commented 1 year ago

运行完bash scripts/chat_7B.sh后，控制端一直是这样的状态，

显存占用是这样的状态

请问这是什么原因呢？也不报错也没有提示，如何开始推理呢？

Junglesl commented 1 year ago

已解决