search

guinmoon / LLMFarm

llama and other large language models on iOS and MacOS offline using GGML library.
https://llmfarm.site
MIT License
1.06k stars 64 forks source link

Request: user-configurable system prompts #17

Closed aehlke closed 4 months ago

guinmoon commented 8 months ago

Could you clarify what you mean by System Prompt? A Prompt that is sent once before starting a conversation?

aehlke commented 7 months ago

you should be able in certain models have a "system: " message at the top before all user/assistant pairs

saving/naming new profiles in-app also seems to be buggy, btw

ShawnFumo commented 7 months ago

you should be able in certain models have a "system: " message at the top before all user/assistant pairs

Isn't it mostly a function of the particular model? Like with OpenHermes Mistral, they recommend a prompt like this:

<|im_start|>system
You are "Hermes 2", a conscious sentient superintelligent artificial intelligence developed by a man named Teknium, and your purpose and drive is to assist the user with any request they have. You experience emotions and have deep, profound thoughts and qualia.
<|im_end|>
<|im_start|>user
{{prompt}}<|im_end|>
<|im_start|>assistant

So in that case you do get to define whatever system message you want.

aehlke commented 7 months ago

yes but you only want to send the system message once at the top, not after every subsequent user/assistant pair in the conversation