Facico / Chinese-Vicuna

Chinese-Vicuna: A Chinese Instruction-following LLaMA-based Model —— 一个中文低资源的llama+lora方案,结构参考alpaca
https://github.com/Facico/Chinese-Vicuna
Apache License 2.0
4.14k stars 425 forks source link

运行chat_7B.sh报错 #208

Open hongshuo-wang opened 1 year ago

hongshuo-wang commented 1 year ago

$ bash scripts/chat_7B.sh

===================================BUG REPORT=================================== Welcome to bitsandbytes. For bug reports, please submit your error trace to: https://github.com/TimDettmers/bitsandbytes/issues

normalizer.cc(51) LOG(INFO) precompiled_charsmap is empty. use identity normalization.

load raw models from /hthh_data/huggingface/models/vicuna-v1.1-model/llama-13b-hf load lora models from /hthh_data/huggingface/models/Chinese-Vicuna-lora-13b-belle-and-guanaco Loading checkpoint shards: 100%|█████████████████████████████████████████████████████████████████| 3/3 [00:13<00:00, 4.50s/it] /home/hthh/anaconda3/envs/chinese-vicuna/lib/python3.10/site-packages/gradio/components.py:147: UserWarning: Unknown style parameter: height warnings.warn(f"Unknown style parameter: {key}") Running on local URL: http://127.0.0.1:7860

To create a public link, set share=True in launch(). Exception ignored in: <generator object wrapper at 0x7fad1e31e1f0> Traceback (most recent call last): File "/home/hthh/anaconda3/envs/chinese-vicuna/lib/python3.10/site-packages/anyio/_backends/_asyncio.py", line 862, in run context, func, args, future = item RuntimeError: generator ignored GeneratorExit Exception ignored in: <generator object wrapper at 0x7fad1e31c3c0> Traceback (most recent call last): File "/home/hthh/anaconda3/envs/chinese-vicuna/lib/python3.10/site-packages/anyio/_backends/_asyncio.py", line 862, in run context, func, args, future = item RuntimeError: generator ignored GeneratorExit Exception ignored in: <generator object wrapper at 0x7fad1e31eb20> Traceback (most recent call last): File "/home/hthh/anaconda3/envs/chinese-vicuna/lib/python3.10/site-packages/anyio/_backends/_asyncio.py", line 862, in run context, func, args, future = item RuntimeError: generator ignored GeneratorExit

当chat模式下,提问后,会正常生成回复,但是紧接着他会自动再写下一句,并且之前生成的回复又消失了,只保留了最后一句 instruct模式下正常