It seems like I can't use beluga2 in m2max. I'm getting the following error.

openlm-research / open_llama

OpenLLaMA, a permissively licensed open source reproduction of Meta AI’s LLaMA 7B trained on the RedPajama dataset

Apache License 2.0

7.27k stars 370 forks source link

It seems like I can't use beluga2 in m2max. I'm getting the following error. #85

Closed mudman21 closed 11 months ago

mudman21 commented 11 months ago

ValueError: The currentdevice_maphad weights offloaded to the disk. Please provide anoffload_folderfor them. Alternatively, make sure you havesafetensorsinstalled if the model you are using offers the weights in this format.

young-geng commented 11 months ago

I'm not sure if this is the right GitHub project to get help with this question, as this is the project page for OpenLLaMA, and we are not familiar with the beluga2 project.