perhaps system prompt should be session related not global

cogentapps / chat-with-gpt

An open-source ChatGPT app with a voice

https://www.chatwithgpt.ai

MIT License

2.31k stars 493 forks source link

perhaps system prompt should be session related not global #35

Open diemus opened 1 year ago

diemus commented 1 year ago

great project. I was thinking build something like this by myself, just don't have time to do it. in my original plan, I think system prompt should be a session related config, thusly user can switch between different type of sessions. and there should be a prompt store. in each session, user could use different prompt templates. just share some ideas

mihha commented 1 year ago

Can you please explain the purpose of that system prompt? I have to admit that I don't understand what is that parameter used for and how can we utilize it 🤔

Thank you in advance!

diemus commented 1 year ago

it's like multitasking, for example, I could create a session that focus on translate, and another session for text extraction. the purpose is to save my time to write a lot of prompt every time for each kind of task. but maybe system prompt is not a good idea, I guess user prompt is good enough for this. I found a project that user / as a quick method for user prompt. https://github.com/Chanzhaoyu/chatgpt-web/blob/main/README.en.md

cogentapps commented 1 year ago

Good idea. Each chat session should have its own system prompt. The system prompt should be saved with the chat, so if you go back to an old chat, it remembers the system prompt. And there can be a button below the System Prompt setting to 'make this the default' for future sessions.

I won't be able to implement this right away, but will add it to the roadmap.

diemus commented 1 year ago

@cogentapps I think we should also have a session based conversation compact strategy. like

simple QA mode. just answer the last question
scrolling mode. just put the recent N msg in the context
user only mode. just remember user's question and put it into the context
compact mode. use gpt to compact context before adding a new question.
custom mode: we could delete user/assistant message to reduce the context

for example, if i want set a session as a helper for translate. I could set a system prompt and a simple QA mode to save unnecessary context token consume. finish all the same type job in this session.