how to let the language model know about previous exchanges when using the API?

PromtEngineer / localGPT

Chat with your documents on your local device using GPT models. No data leaves your device and 100% private.

Apache License 2.0

19.94k stars 2.22k forks source link

how to let the language model know about previous exchanges when using the API? #417

Open valdesguefa opened 1 year ago

valdesguefa commented 1 year ago

before posing my problem, i'd like to thank you for the work you do. i'd like to make a bot that responds to user concerns about the content of certain files. for the conversation to be as natural as possible, i need the bot to have knowledge of previous exchanges. for example -user: where is france? -bot: <> -user: what is its surface area? any help would be welcome.

AutumnEvans418 commented 1 year ago

Just out of curiosity, is the bot coherent if you include your original question and its response in the next question you ask? If so, maybe there's a way to just store previous conversations if the last response can fit in the token limit.