LostRuins / koboldcpp

A simple one-file way to run various GGML and GGUF models with KoboldAI's UI
https://github.com/lostruins/koboldcpp
GNU Affero General Public License v3.0
4.34k stars 310 forks source link

Unclear error message when provide wrong gbnf #935

Open Kas1o opened 1 week ago

Kas1o commented 1 week ago

In the latest llama.cpp build. (b3190) if you provide a grammer without definition of root then will get a error like below:

llama_sampling_init: grammar does not contain a 'root' symbol
 ERR [              send_error] task error | ... error="Failed to parse grammar"

And, In koboldcpp1.68 windows cuda12 there will only have:

[WinError -529697949] Windows Error 0xe06d7363