Closed beebopkim closed 5 months ago
Try disabling ContextShift. --noshift
ContextShift is only for gguf
SmartContext should work for ggml
Try disabling ContextShift.
--noshift
ContextShift is only for gguf
SmartContext should work for ggml
I put --noshift and tried to do it again, and it was failed with the same error message.
No, support is not dropped but I can confirm it has been broken since 1.56. I will try to fix it if possible.
found the bug. fixed in my experimental branch.
I checkouted concedo_experimental branch and has confirmed that old GGML format is now working. Thanks for your fast response!
Latest version is released, which should have this fixed.
I confirmed that b67a906 tags/v1.60 is working with old GGML models very well. Thanks!
I tried to run a old GGML model from https://huggingface.co/StarFox7/Llama-2-ko-7B-chat-gguf , and found that it was failed.
And I also found that program from tag v1.56 loads this model in old GGML format.
So I have a question; Is old GGML format dropped?