cmp-nct / ggllm.cpp

Falcon LLM ggml framework with CPU and GPU support
Other
244 stars 21 forks source link

Sys-msg-improvements #60

Closed maddes8cht closed 1 year ago

maddes8cht commented 1 year ago

I think the -e option should handle not only the prompt (-p) but also the system prompt (-sys). Also, there should be support for the system prompt to read from a file as well as the prompt. This PR implements both of these:

Added support for loading the system prompt from a file: Introduction of -sysf FNAME and --system-file FNAME command line options.

Improved processing of the -e escape sequence for both the prompt and the system prompt.