janhq / jan

Jan is an open source alternative to ChatGPT that runs 100% offline on your computer. Multiple engine support (llama.cpp, TensorRT-LLM)
https://jan.ai/
GNU Affero General Public License v3.0
20.79k stars 1.19k forks source link

feat: Save system prompt to assistant(s) #2255

Open frostime opened 4 months ago

frostime commented 4 months ago

Problem Now jan has supported to edit the system prompt at side bar, it's good, but I think it may be necessary to allow user to create a bot (i.e. to save the system prompt as a template) so as to easily manage the frequently used system prompt.

Success Criteria The bot/agent/template, whatever to denote, has been widely supported in various LLM applications. I think we can

  1. add a page to manage and create the template, allow users pre-define the system prompt
  2. allow users to start a conversation from a chat template, where the pre-defined system prompt is automatically filled
  3. for a more powerful implementation, I think we can reference to ChatGPT-Next-Web, not only allow users to pre-defined system prompt, but also a customized conversation history like this

    image

Additional context

Reference:

iamhenry commented 2 months ago

where in the priority list is this? i would love something like this. it would enable custom gpt's just like openAI @imtuyethan

iAdanos commented 1 month ago

In fact, I would say, this is a feature about saving default or available promts and it would be great. Currently it seems that i have to specify my default promt each time i start a thread and copy-paste it from somewhere else.