marella / ctransformers

Python bindings for the Transformer models implemented in C/C++ using GGML library.
MIT License
1.8k stars 137 forks source link

2nd Generation is really bad #146

Open jojac47 opened 1 year ago

jojac47 commented 1 year ago

Any Ideas as to why the first generation for a model instance is good but if I try to run that same instance with a new prompt it either returns nothing or jumbled grossness.