Open durandarthur opened 2 months ago
https://github.com/lee-b/kobold_assistant/blob/2add917b6d3f31764bd2e9d97a9cd8c6ef841aef/README.md?plain=1#L153
The line above does not have the intended effects on its own. The model file should be renamed to "stable-vicuna-13B-GPTQ-4bit.compat.no-act-order.safetensors".
Here is the commit where the file was renamed:
https://huggingface.co/TheBloke/stable-vicuna-13B-GPTQ/commit/e6a3a2f1bdaa6589e5a06f8bbb5af78e618c269e#:~:text=%7D-,stable%2Dvicuna%2D13B%2DGPTQ%2D4bit.compat.no%2Dact%2Dorder.safetensors%20%E2%86%92%20model.safetensors,-RENAMED
Sounds likely. Thanks.
lee-b
commented
3 weeks ago
https://github.com/lee-b/kobold_assistant/blob/2add917b6d3f31764bd2e9d97a9cd8c6ef841aef/README.md?plain=1#L153
The line above does not have the intended effects on its own. The model file should be renamed to "stable-vicuna-13B-GPTQ-4bit.compat.no-act-order.safetensors".
Here is the commit where the file was renamed:
https://huggingface.co/TheBloke/stable-vicuna-13B-GPTQ/commit/e6a3a2f1bdaa6589e5a06f8bbb5af78e618c269e#:~:text=%7D-,stable%2Dvicuna%2D13B%2DGPTQ%2D4bit.compat.no%2Dact%2Dorder.safetensors%20%E2%86%92%20model.safetensors,-RENAMED