bump jll version, add server executable with a docstring

marcom / Llama.jl

Julia interface to llama.cpp, a C/C++ library for running language models

MIT License

23 stars 2 forks source link

Closed svilupp closed 8 months ago

svilupp commented 8 months ago

Changes:

Bump llama_cpp.jll version from 0.12 to 0.15 (today's upstream release)
Add command to start an HTTP server + basic docstring for it (follows the naming conventions run_server)

marcom commented 8 months ago

Wow, thanks for this PR :) Looks good!