-
### Describe the bug
when use ollama with model llama3:70b, the python code return with a "`" ,caused the code cannot be executed.
### Reproduce
1. run interpreter by this command . interpreter --m…
-
I have followed the installation instructions using a Windows 10 computer with NVIDIA GPU onboard using python version 3.9. I went through previous detectron2 issues in the Issues tab.
When attempt…
-
### Check for existing issues
- [X] Completed
### Describe the bug / provide steps to reproduce it
When I configure OpenAI, I only see a field for API key but no field to enter URL and port. In my …
-
Hi there!
i'd like to have this extension running on my Text generation web UI but have this error and being new to this local LLaMA AND having limited understanding of python i have this error i c…
-
This extension looks very interesting but when trying to add a steering vector, I get this error. Any ideas how to solve it?
Traceback (most recent call last):
File "C:\Users\XYZ\miniconda3\envs…
-
### 🐛 Describe the bug
I am deploying a model using torchserve. It was easily deployed on Tesla K80 GPU. But now when i shifted it to newer GPU Nvidia A30. I am getting this error
```
torch…
-
### Describe the bug
Whenever I try to train a LoRA, when it tries to reload the model, it breaks.
### Is there an existing issue for this?
- [x] I have searched the existing issues
### Re…
-
Even when tooling is disabled the Agents code still expects function calling and expects that from the output of the llm.
I use oobabooga as the local llm and it does not support function calling y…
-
Training the 7B model takes about 18GB of RAM.
I tried training the 13B model, and ran out of VRAM on my 24GB card. I suspect, will need at least 32GB of VRAM.
Has anyone else been successful w…
-
DRY is a modern repetition penalty that is superior to the standard frequency and presence penalties at preventing repetition, while having virtually none of their negative effects on language quality…
p-e-w updated
2 months ago