-
Not sure if this feasable but would love to see a modified save checkpoint node for this somehow so we can save save gguf or exl2 for merging in loras to a gguf or exl2 checkpoint directly.
Check o…
-
**Describe the bug**
I'm using VSCode from a Windows machine connected to Linux via SSH.
When there is an unsaved Interactive Jupyter window in the tabs list - Twinny gets stuck on autocomplete (in …
-
I don't normally use Windows, but this is also a common request.
-
Several services have started to make the OpenAI API standard their own. Not only if you (for some unknown reason) want to use Azure OpenAI Service, but most notably Oobabooga has recently migrated th…
-
Here's another bug on Oobabooga's project that is unresolved...
https://github.com/oobabooga/text-generation-webui/issues/2923
I realized that the ExLlama team may have a solution....
So thought I'…
-
UPDATE:
I was able to get the plugin working by following the install directions and then re-updating Ooba which replaced some of the files. The output made me think it would not work but so far, t…
-
Zephyr 7B model is kind of the best in small size models and is able to outperform GPT 3.5 and Llama 70B models as well in some tasks. See benchmark:
https://huggingface.co/HuggingFaceH4/zephyr-7b-be…
-
Flashv2 is based on CUTLASS v3, which [does not support windows](https://github.com/NVIDIA/cutlass#operating-systems) at the moment.
I have [a bunch of errors](https://pastebin.com/Z0bKnbjE) - I'll t…
-
Hello there!
I already managed to launch and make it work, but now I am facing a problem where the langchain is not reading the PDF file
I am using thise LLM:
all_datasets_v4_MiniLM-L6
vicuna-…
-
https://github.com/oobabooga/text-generation-webui
我用的int4版本
加载模型时，提示
OSError: models/ChatLLaMA-zh-7B-int4 does not appear to have a file named config.json
需要一个config.json ?