search

acon96 / home-llm

A Home Assistant integration & Model to control your smart home using a Local LLM
490 stars 56 forks source link

Attempting to load an invalid GBNF crashes Home Assistant #70

Open acon96 opened 4 months ago

acon96 commented 4 months ago

Describe the bug If you attempt to load a GBNF grammar file that is invalid syntax, the llama-cpp-python C extension crashes the entire Home Assistant process and must be restarted.

Expected behavior An error message would tell the user that the grammar file is invalid.

Logs N/A

joelis10 commented 2 months ago

crashes on setup for me too, not sure if its due to GBNF values though