Mozilla-Ocho / llamafile

Distribute and run LLMs with a single file.
https://llamafile.ai
Other
18.86k stars 953 forks source link

Jinja placeholders replaced with "undefined" #264

Open adam-ahern opened 6 months ago

adam-ahern commented 6 months ago

I asked wizardcoder-python-13b.llamafile to generate some Ansible for me. It was willing to do so, however as jinja2 placeholders were generated they were immediately replaced by "undefined" as if they are triggering some string replacement.

jart commented 6 months ago

Is this an issue with the server web UI? Could you help me understand how to reproduce this?

adam-ahern commented 6 months ago

Yes, to reproduce it just start the wizardcoder llamafile, go to the web UI, and prompt it to give you some ansible code..