search

OoriData / OgbujiPT

Client-side toolkit for using large language models, including where self-hosted
Apache License 2.0
101 stars 8 forks source link

Sliding message window support for messages_db #75

Closed uogbuji closed 5 months ago

uogbuji commented 5 months ago

Right now, embedding.pgvector_message.MessageDB operates append-only, but in many cases the user only ever wants the most recent messages to context. Implement an optional system to automatically clean up old messages.