How do I start text-generation-webui ?

kasnerz / quintd

Data-to-text generation with LLMs using ad-hoc datasets.

https://d2t-llm.github.io

MIT License

7 stars 2 forks source link

Closed oplatek closed 3 months ago

oplatek commented 3 months ago

I started the text-generation-webui with the following command

 server.py --settings settings_local.yaml --listen --listen-host 0.0.0.0 --api --model "mistralai_Mistral-7B-Instruct-v0.1"

I tested the command

python model/generate.py -d ice_hockey -s direct -m mistral -p data/quintd-1 -a $TG_WEBUI_API_URL

I always get the following :(

2024-06-21 08:44:40 INFO Loading model mistralai/Mistral-7B-Instruct-v0.2
{'detail': 'Not Found'}  # response from the server

oplatek commented 3 months ago

I solved the errors in this commit where I committed your uncommitted changes and added minor improvements