python cli_demo_sat.py --from_pretrained cogagent-chat --version chat --bf16 --stream_chat
[2024-11-28 05:54:25,880] [INFO] [real_accelerator.py:219:get_accelerator] Setting ds_accelerator to cuda (auto detect)
Traceback (most recent call last):
File "/workspace/kkkjr/Item/CogVLM/basic_demo/cli_demo_sat.py", line 12, in
from utils.utils import chat, llama2_tokenizer, llama2_text_processor_inference, get_image_processor
File "/workspace/kkkjr/Item/CogVLM/utils/utils/init.py", line 2, in
from .language import llama2_tokenizer, llama2_text_processor, llama2_text_processor_inference
File "/workspace/kkkjr/Item/CogVLM/utils/utils/language.py", line 1, in
from sat.model.official.llama_model import LLaMAModel, rotate_half
ImportError: cannot import name 'rotate_half' from 'sat.model.official.llama_model' (/home/wpg/anaconda3/envs/CogAgent/lib/python3.9/site-packages/sat/model/official/llama_model.py)
python cli_demo_sat.py --from_pretrained cogagent-chat --version chat --bf16 --stream_chat [2024-11-28 05:54:25,880] [INFO] [real_accelerator.py:219:get_accelerator] Setting ds_accelerator to cuda (auto detect) Traceback (most recent call last): File "/workspace/kkkjr/Item/CogVLM/basic_demo/cli_demo_sat.py", line 12, in
from utils.utils import chat, llama2_tokenizer, llama2_text_processor_inference, get_image_processor
File "/workspace/kkkjr/Item/CogVLM/utils/utils/init.py", line 2, in
from .language import llama2_tokenizer, llama2_text_processor, llama2_text_processor_inference
File "/workspace/kkkjr/Item/CogVLM/utils/utils/language.py", line 1, in
from sat.model.official.llama_model import LLaMAModel, rotate_half
ImportError: cannot import name 'rotate_half' from 'sat.model.official.llama_model' (/home/wpg/anaconda3/envs/CogAgent/lib/python3.9/site-packages/sat/model/official/llama_model.py)
为啥会出现引入不了 'rotate_half'的情况呢