THUDM / VisualGLM-6B

Chinese and English multimodal conversational language model | 多模态中英双语对话语言模型
Apache License 2.0
4.08k stars 415 forks source link

ERROR: Unknown arg use_final_layernorm #53

Open yaofeng opened 1 year ago

yaofeng commented 1 year ago

This is my code:

from transformers import AutoTokenizer, AutoModel

tokenizer = AutoTokenizer.from_pretrained("THUDM/visualglm-6b", trust_remote_code=True)
model = AutoModel.from_pretrained("THUDM/visualglm-6b", trust_remote_code=True).half().cuda()

It runs failed, and returned "ValueError: Unknown arg use_final_layernorm."

What's the problem?

Sleepychord commented 1 year ago

could you check the version of SwissArmyTransformer? upgrade it to >=0.3.6

wyw0907 commented 1 year ago

I am using virtualglm on the ARM platform. When I tried to install SwissArmyTransformer version 0.3.6 or later using 'pip install SwissArmyTransformer>=0.3.6', it actually installed version 0.3.2. I resolved the issue by using the command 'pip install SwissArmyTransformer==0.3.6' to install the precise version of the package.