KoboldAI / KoboldAI-Client

For GGUF support, see KoboldCPP: https://github.com/LostRuins/koboldcpp
https://koboldai.com
GNU Affero General Public License v3.0
3.51k stars 758 forks source link

Is it possible to run CodeGen model in KoboldAI? #247

Open AndreyRGW opened 1 year ago

AndreyRGW commented 1 year ago

https://huggingface.co/Salesforce/codegen-2B-multi

SparksSkywere commented 1 year ago

I tested it lastnight and at the moment, no.

Though I checked and potentially updating to the latest torch version will fix the issue as it is brought up by codegen on their GIT and Torch, so bare with the devs here and it will work in the future!