Closed svilupp closed 9 months ago
As part of this, I've noticed that run_chat
is infinite :D CTRL+c control sequence gets eaten by REPL, so we can't kill it... Will open an issue
This one is good to go.
I'll fix the SIGINT issue separately, but we first need to merge this.
run_llama
,run_chat
, andrun_server
to be more informative.run_*
parameters to be more sensible for first-time users, including therun_server
port number (port=10897
) to be unique and not clash with other services.Default parameter changes:
Added README reference how to start the server.