search

AlpinDale / pygmalion.cpp

C/C++ implementation of PygmalionAI/pygmalion-6b
MIT License
56 stars 5 forks source link

Failed to load model #4

Open TheGreatPearTree opened 1 year ago

TheGreatPearTree commented 1 year ago

I'm very tech dumb and am receiving this error when trying to run the model. I did make sure the model was in the models folder and was the correct version.

(base) user@DESKTOP:~/pygmalion.cpp/build$ ./bin/pyggy -m models/pygmalion-6b-Main-q4_0.bin main: seed = 1680089369 gptj_model_load: loading model from 'models/pygmalion-6b-Main-q4_0.bin' - please wait ... gptj_model_load: failed to open 'models/pygmalion-6b-Main-q4_0.bin' main: failed to load model from 'models/pygmalion-6b-Main-q4_0.bin'

AlpinDale commented 1 year ago

You're getting the model name wrong. It's pygmalion-6b-v3-q4_0.bin.

TheGreatPearTree commented 1 year ago

I've corrected the model name, but it is still failing to load.

(base) user@DESKTOP:~/pygmalion.cpp/build$ ./bin/pyggy -m models/pygmalion-6b-v3-q4_0.bin main: seed = 1680099631 gptj_model_load: loading model from 'models/pygmalion-6b-v3-q4_0.bin' - please wait ... gptj_model_load: failed to open 'models/pygmalion-6b-v3-q4_0.bin' main: failed to load model from 'models/pygmalion-6b-v3-q4_0.bin'

AlpinDale commented 1 year ago

I've corrected the model name, but it is still failing to load.

(base) user@DESKTOP:~/pygmalion.cpp/build$ ./bin/pyggy -m models/pygmalion-6b-v3-q4_0.bin main: seed = 1680099631 gptj_model_load: loading model from 'models/pygmalion-6b-v3-q4_0.bin' - please wait ... gptj_model_load: failed to open 'models/pygmalion-6b-v3-q4_0.bin' main: failed to load model from 'models/pygmalion-6b-v3-q4_0.bin'

You're trying to load the model from the models/ subdirectory inside the build/ directory. You'll need to load it from ../examples/pyggy/models/pygmalion-6b-v3-q4_0.bin instead. I'll add this to the README.

TheGreatPearTree commented 1 year ago

Changing the directory worked, but I had to copy the bin folder into ../examples/pyggy/.