search

deadbits / trs

🔭 Threat report analysis via LLM and Vector DB
https://trs.deadbits.ai
Apache License 2.0
9 stars 1 forks source link

Support message history #1

Closed deadbits closed 1 year ago

deadbits commented 1 year ago

Add support for maintaining a chat message history between the user and the LLM.

This should be easy enough to do; new user messages and assistant responses are appended to the messages list and passed back and forth. Add some logic to pop the oldest message when we get too close to the token limit or maybe just cap at a certain number of messages.

deadbits commented 1 year ago

Closing this as I plan to watch to OpenAIs new threads