===================================BUG REPORT===================================
Welcome to bitsandbytes. For bug reports, please submit your error trace to: https://github.com/TimDettmers/bitsandbytes/issues
normalizer.cc(51) LOG(INFO) precompiled_charsmap is empty. use identity normalization.
load raw models from /hthh_data/huggingface/models/vicuna-v1.1-model/llama-13b-hf
load lora models from /hthh_data/huggingface/models/Chinese-Vicuna-lora-13b-belle-and-guanaco
Loading checkpoint shards: 100%|█████████████████████████████████████████████████████████████████| 3/3 [00:13<00:00, 4.50s/it]
/home/hthh/anaconda3/envs/chinese-vicuna/lib/python3.10/site-packages/gradio/components.py:147: UserWarning: Unknown style parameter: height
warnings.warn(f"Unknown style parameter: {key}")
Running on local URL: http://127.0.0.1:7860
To create a public link, set share=True in launch().
Exception ignored in: <generator object wrapper at 0x7fad1e31e1f0>
Traceback (most recent call last):
File "/home/hthh/anaconda3/envs/chinese-vicuna/lib/python3.10/site-packages/anyio/_backends/_asyncio.py", line 862, in run
context, func, args, future = item
RuntimeError: generator ignored GeneratorExit
Exception ignored in: <generator object wrapper at 0x7fad1e31c3c0>
Traceback (most recent call last):
File "/home/hthh/anaconda3/envs/chinese-vicuna/lib/python3.10/site-packages/anyio/_backends/_asyncio.py", line 862, in run
context, func, args, future = item
RuntimeError: generator ignored GeneratorExit
Exception ignored in: <generator object wrapper at 0x7fad1e31eb20>
Traceback (most recent call last):
File "/home/hthh/anaconda3/envs/chinese-vicuna/lib/python3.10/site-packages/anyio/_backends/_asyncio.py", line 862, in run
context, func, args, future = item
RuntimeError: generator ignored GeneratorExit
$ bash scripts/chat_7B.sh
===================================BUG REPORT=================================== Welcome to bitsandbytes. For bug reports, please submit your error trace to: https://github.com/TimDettmers/bitsandbytes/issues
normalizer.cc(51) LOG(INFO) precompiled_charsmap is empty. use identity normalization.
To create a public link, set
share=True
inlaunch()
. Exception ignored in: <generator object wrapper at 0x7fad1e31e1f0> Traceback (most recent call last): File "/home/hthh/anaconda3/envs/chinese-vicuna/lib/python3.10/site-packages/anyio/_backends/_asyncio.py", line 862, in run context, func, args, future = item RuntimeError: generator ignored GeneratorExit Exception ignored in: <generator object wrapper at 0x7fad1e31c3c0> Traceback (most recent call last): File "/home/hthh/anaconda3/envs/chinese-vicuna/lib/python3.10/site-packages/anyio/_backends/_asyncio.py", line 862, in run context, func, args, future = item RuntimeError: generator ignored GeneratorExit Exception ignored in: <generator object wrapper at 0x7fad1e31eb20> Traceback (most recent call last): File "/home/hthh/anaconda3/envs/chinese-vicuna/lib/python3.10/site-packages/anyio/_backends/_asyncio.py", line 862, in run context, func, args, future = item RuntimeError: generator ignored GeneratorExit当chat模式下,提问后,会正常生成回复,但是紧接着他会自动再写下一句,并且之前生成的回复又消失了,只保留了最后一句 instruct模式下正常