search

Mozilla-Ocho / llamafile

Distribute and run LLMs with a single file.
https://llamafile.ai
Other
16.75k stars 830 forks source link

llama_sampling_init: failed to parse grammar #458

Closed cbail closed 1 month ago

cbail commented 1 month ago

Contact Details

christopherandrewbail@gmail.com

What happened?

Hi all- love your tool and used it in the past. I just tried to install LLAMA 3, however, and got the following error message. I'm a bit of a noob, so apologies if this has been addressed elsewhere but I could not find a similar issue documented in the repo:

Version

v.0.8.4

What operating system are you seeing the problem on?

Mac

Relevant log output

llama_sampling_init: failed to parse grammar
launch_slot_with_data: failed to initialize sampling subsystem
task 8 - error: internal_error
cbail commented 1 month ago

Argh, sorry. Issue resolved on reboot :(