Autostart the llama.cpp server example

gsuuon / model.nvim

Neovim plugin for interacting with LLM's and building editor integrated prompts.

MIT License

293 stars 21 forks source link

Autostart the llama.cpp server example #22

Closed gsuuon closed 8 months ago

gsuuon commented 9 months ago

Start the llama.cpp server the first time a prompt is requested. Also need to add options to the llama.cpp provider for the binary directory. Check the previous llama.cpp ./main provider for an example.