search

snexus / llm-search

Querying local documents, powered by LLM
MIT License
518 stars 60 forks source link

Passing history in context to remember conversation #101

Closed mohammad-yousuf closed 7 months ago

mohammad-yousuf commented 8 months ago

Hi,

Is it possible to pass history in the context for the model to remember and trim the history according to context length?

snexus commented 8 months ago

Keeping conversational history isn't an easy problem with RAGs. I will explore how to implement this

snexus commented 8 months ago

I've created an initial implementation in the feature branch here - https://github.com/snexus/llm-search/tree/feature-conversation-history The chat history length is adjustable via UI (to have enough space for the context).

Please try it out, before merging to main.

mohammad-yousuf commented 8 months ago

Thank you @snexus , will try this out.