search

ssbuild / chatglm2_finetuning

chatglm2 6b finetuning and alpaca finetuning
Apache License 2.0
144 stars 17 forks source link

推断的时候报错 #14

Open dayu1979 opened 1 year ago

dayu1979 commented 1 year ago

Expected all tensors to be on the same device, but found at least two devices, cuda:0 and cpu! (when checking argument for argument index in method wrapper_CUDA__index_select)

ssbuild commented 1 year ago

which infer ? and show more error

dayu1979 commented 1 year ago

应该是model_zoo的ChatGLMTokenizer类的问题，返回的tensor在cpu上，而模型是在gpu，导致该错误发生。

ssbuild commented 1 year ago

yes , fixed