Open TheGreatPearTree opened 1 year ago
You're getting the model name wrong. It's pygmalion-6b-v3-q4_0.bin
.
I've corrected the model name, but it is still failing to load.
(base) user@DESKTOP:~/pygmalion.cpp/build$ ./bin/pyggy -m models/pygmalion-6b-v3-q4_0.bin
main: seed = 1680099631
gptj_model_load: loading model from 'models/pygmalion-6b-v3-q4_0.bin' - please wait ...
gptj_model_load: failed to open 'models/pygmalion-6b-v3-q4_0.bin'
main: failed to load model from 'models/pygmalion-6b-v3-q4_0.bin'
I've corrected the model name, but it is still failing to load.
(base) user@DESKTOP:~/pygmalion.cpp/build$ ./bin/pyggy -m models/pygmalion-6b-v3-q4_0.bin
main: seed = 1680099631
gptj_model_load: loading model from 'models/pygmalion-6b-v3-q4_0.bin' - please wait ...
gptj_model_load: failed to open 'models/pygmalion-6b-v3-q4_0.bin'
main: failed to load model from 'models/pygmalion-6b-v3-q4_0.bin'
You're trying to load the model from the models/
subdirectory inside the build/
directory. You'll need to load it from ../examples/pyggy/models/pygmalion-6b-v3-q4_0.bin
instead. I'll add this to the README.
Changing the directory worked, but I had to copy the bin folder into ../examples/pyggy/
.
I'm very tech dumb and am receiving this error when trying to run the model. I did make sure the model was in the models folder and was the correct version.
(base) user@DESKTOP:~/pygmalion.cpp/build$ ./bin/pyggy -m models/pygmalion-6b-Main-q4_0.bin main: seed = 1680089369 gptj_model_load: loading model from 'models/pygmalion-6b-Main-q4_0.bin' - please wait ... gptj_model_load: failed to open 'models/pygmalion-6b-Main-q4_0.bin' main: failed to load model from 'models/pygmalion-6b-Main-q4_0.bin'