RuntimeError: "log_softmax_lastdim_kernel_impl" not implemented for 'Half'

SCIR-HI / Huatuo-Llama-Med-Chinese

Repo for BenTsao [original name: HuaTuo (华驼)], Instruction-tuning Large Language Models with Chinese Medical Knowledge. 本草（原名：华驼）模型仓库，基于中文医学知识的大语言模型指令微调

Apache License 2.0

4.31k stars 422 forks source link

RuntimeError: "log_softmax_lastdim_kernel_impl" not implemented for 'Half' #66

Closed liulj0507 closed 9 months ago

liulj0507 commented 11 months ago

运行infer.sh的时候遇到上面错误，怎么解啊？

s65b40 commented 10 months ago

您好，请确保依赖包的版本号和requirements中一致，如仍有问题，请详细描述使用场景以便排查