-
### Your current environment
```text
The output of `python env.py`
```
PyTorch version: 2.3.1
Is debug build: False
CUDA used to build PyTorch: 12.1
ROCM used to build PyTorch: N/A
OS: Ubuntu …
-
When some special characters are prefixed with a space, in streaming mode, webui including SillyT…
-
I tired the demo code in https://lablab.ai/t/ai-agents-tutorial-how-to-use-and-create-them and got following error:
```
llm_chain.run("What is lablab.ai")
LangChainDeprecationWarning: The method `C…
-
Use this thread for general discussion and debate regarding the Character Card Spec V2. **Anyone** may freely use this thread to discuss the spec. However, if you are an owner or representative for a …
-
**Have you searched for similar [requests](https://github.com/SillyTavern/SillyTavern/issues?q=)?**
Yes
**Is your feature request related to a problem? Please describe.**
Not necessarily a proble…
-
https://huggingface.co/blog/hf-bitsandbytes-integration
As I understand it, this would allow loading 6B models (minus context etc. of course) with 6GB VRAM.
-
Documentation seems to conflict over whether Rep Range being set to 0 or -1 disables range being used, testing with lite.koboldai UI, -1 automatically corrects to 0, and looking at code, 0 completely …
-
**Describe the current behavior**
When running an older version of JAX, the TPU receives the following error:
Traceback (most recent call last):
File "aiserver.py", line 10214, in
load_…
-
Hello,
I heard that SSE streaming over API has now been added in the new update. However, I can't seem to make it work when changing the address from "const response = await axios.post(`${ENDPOINT}…
-
**Describe the Issue**
I see that koboldcpp is licensed under AGPL-v3 license which does not prohibit commercial use of the software but requires to provide access to the source code to the users (in…