-
Hi, @vasilecampeanu !
While GPT-* models are awesome, there's an issue of privacy arising from using an external third party API, especially when the information may be sensitive. More than that, t…
-
when I tried to run Mistral-7B-OpenOrca (using oobabooga/text-generation-webui)Ж
ImportError: libcudart.so.12: cannot open shared object file: No such file or directory
-
# Feature Description
Please provide a detailed written description of what you were trying to do, and what you expected `llama.cpp` to do as an enhancement.
# Motivation
It sounds like it's …
-
I have followed the installation instructions using a Windows 10 computer with NVIDIA GPU onboard using python version 3.9. I went through previous detectron2 issues in the Issues tab.
When attempt…
-
Hi, Apologies i seem to be unable to figure this out.
When using the Webui to download a model the list loads correctly and it also downloads giving the confirmation **"Model successfully saved to …
-
![Screenshot - 2024-05-06 10 11 56](https://github.com/mamei16/LLM_Web_search/assets/115493464/be3c8f01-0173-4cc9-b618-0a3f1c5d4d99)
-
I see that there are many PRs about [StaticCache](https://github.com/huggingface/transformers/pulls?q=is%3Apr+StaticCache), but I couldn't find a clear documentation on how to use it.
#### What I w…
-
I don't normally use Windows, but this is also a common request.
-
My ComfyUI is not the portable. I installed the Searge LLM with the ComfyUI manager, then I installed it manually, in both cases; I got the Traceback below error. I tried to Install the following comm…
-
Zephyr 7B model is kind of the best in small size models and is able to outperform GPT 3.5 and Llama 70B models as well in some tasks. See benchmark:
https://huggingface.co/HuggingFaceH4/zephyr-7b-be…