RuntimeError: "addmm_impl_cpu_" not implemented for 'Half'

AGI-Edgerunners / LLM-Adapters

Code for our EMNLP 2023 Paper: "LLM-Adapters: An Adapter Family for Parameter-Efficient Fine-Tuning of Large Language Models"

https://arxiv.org/abs/2304.01933

Apache License 2.0

1.01k stars 91 forks source link

RuntimeError: "addmm_impl_cpu_" not implemented for 'Half' #19

Open ljbigbang opened 1 year ago

ljbigbang commented 1 year ago

Hello，when I run generate.py , I got the error : RuntimeError: "addmm_implcpu" not implemented for 'Half' . But I am sure I was using GPU to run it . What should I do to solve this problem. Thanks!

HZQ950419 commented 1 year ago

Hi, may I ask if you have the same issue running evaluate.py? If you can provide information about your GPUs, the cuda and bnb versions will be helpful.