bigcode-project / starcoder.cpp

C++ implementation for 💫StarCoder
443 stars 36 forks source link

Attempts at converting fine-tuned models fail without explanation #15

Open umm-maybe opened 1 year ago

umm-maybe commented 1 year ago

I attempted to convert StarChat as well as my own fine-tune of SantaCoder to create more conversational models, and neither works. With SantaCoder the result is the following error:

[process exited with code 7 (0x00000007)]

My guess was that my system didn't have enough resources, so I tried running it in Colab using my Pro plan. It printed ^C and halted, something I've never seen before.

I haven't been able to replicate the conversion steps for the base models either...

NouamaneTazi commented 1 year ago

Can you provide the full stacktrace and which script you tried to run?