search

Mozilla-Ocho / llamafile

Distribute and run LLMs with a single file.
https://llamafile.ai
Other
19.39k stars 982 forks source link

example of commandline chat #389

Closed magdesign closed 4 months ago

magdesign commented 5 months ago

thanks for this great tool!

i'd love to have an example in the readme on how to run/start this in cli in a 'question and answer' chat mode, since it seems only possible to launch it with a question in the launcher script. the idea is to launch and get a terminal waiting for the promt (simillar to how ollama handles it)

magdesign commented 4 months ago

to use this in chat mode in terminal, you need to use the chat.sh file.

this, of corse, will not prevent the browser popping up on first launch, but at least you can use it without wasting extra ressources of having firefox open.