-
- env
```
org.springframework.ai
spring-ai-zhipuai-spring-boot-starter
1.0.0-SNAPSHOT
```
- code
```
// message = "I'm visiting Jon Snow. The blood pressure looks fine: 120/80.…
-
Hi there, I am using a program called Kobold.cpp to run a model locally. I decided to try Smart Connections today and I tried to connect the plugin to kobold.
Model Name: Flam
Protocol: http
hos…
-
```
(textgen) [root@pve-m7330 sparsegpt]# python llama.py ../text-generation-webui/models/TinyLlama-1.1B-Chat-v1.0/ wikitext2 --nsamples 10
Token indices sequence length is longer than the specified…
-
### Describe the bug
I install environment manually.
conda create -n textgen python=3.11
conda activate textgen
pip3 install torch==2.2.2 torchvision==0.17.2 torchaudio==2.2.2 --index-url https:/…
-
Are there any plans to support models loaded in TextGen WebUI?
osok updated
5 months ago
-
**Describe the bug**
A clear and concise description of what the bug is.
pip install sqlalchemy
python r2r/examples/quickstart.py
-
How can I use this with say a litellm provider? I see litellm in the code. Can't I just point to text-generation-webui's openai endpoint?
```
import os
from litellm import completion
## set …
-
Ubuntu 22.04LTS comes with Python 3.10. 22.04LTS is replaced by 24.04LTS. 24.04LTS has Python 3.11. Ubuntu 22.04 with Python 3.10 is causing issues with LLM_Web_search.
```
LLM_Web_search | uber g…
-
I tried
```
ModuleNotFoundError: No module named 'icecream'
(textgen) [root@pve0 DocOwl1.5]# pip install icecream
Collecting icecream
Using cached icecream-2.1.3-py2.py3-none-any.whl.metadata…
-
Hi i set my export OPENAI_ENDPOINT=http://127.0.0.1:5000/v1 as i am running a model throw textgen ui but when i execute kubectl ai "create an nginx deployment with 3 replicas"
I get error
⣾ Processi…