Closed jackNhat closed 5 months ago
Likely a duplicated of my opening issue #22
PR was merged. It should work fine now.
@datquocnguyen Not working
Same issue
@001123 @churongcon Please could you try installing/compiling llama.cpp from this specific commit and then redo the conversion step (to create the .gguf file):
https://github.com/jordankanter/llama.cpp/tree/87a41f53ae3a01dde4c198df72cfb99ba2c9f586
git clone https://github.com/jordankanter/llama.cpp
git checkout 87a41f53ae3a01dde4c198df72cfb99ba2c9f586
@001123 @churongcon, please disregard my previous comment. I have found the reason. "llama.cpp" has been modified, resulting in a converted version of phogpt-4b being associated with 387 tensors, instead of the previous 388. To load it with the latest version of Studio, you can simply reconvert phogpt-4b using the latest "llama.cpp".
@001123 @churongcon please try https://huggingface.co/vinai/PhoGPT-4B-Chat-gguf
I converted the model into the llama.cpp's own format (.GGUF). And this model could run successful in colab like snapshot.
But when i loaded this model in LLM Studio or Jan, i got error message. Anyone met this problem? How to resolve this?
Many thanks!