search

THUDM / CodeGeeX2

CodeGeeX2: A More Powerful Multilingual Code Generation Model
https://codegeex.cn
Apache License 2.0
7.62k stars 533 forks source link

从hugging下载codegeex2-6b-int4本地加载模型后输出结果完全不对 #153

Open ivankxt opened 11 months ago

ivankxt commented 11 months ago

hi，我从https://huggingface.co/THUDM/codegeex2-6b-int4/tree/main下载的codegeex2-6b-int4；然后在V100 GPU机器上加载模型，输出结果完全不对，请问这是什么原因？Stanislas0

image image

Originally posted by @ivankxt in https://github.com/THUDM/CodeGeeX2/issues/34#issuecomment-1803078379