Closed rachtsingh closed 10 months ago
It produces the same output on TheBloke/Llama-2-13B-Guanaco-QLoRA-GPTQ main, but it should fix the second error in https://github.com/srush/llama2.rs/issues/23.
TheBloke/Llama-2-13B-Guanaco-QLoRA-GPTQ main
The first error seems related to https://huggingface.co/blog/gptq-integration.
It produces the same output on
TheBloke/Llama-2-13B-Guanaco-QLoRA-GPTQ main, but it should fix the second error in https://github.com/srush/llama2.rs/issues/23.The first error seems related to https://huggingface.co/blog/gptq-integration.