search

marcusschiesser / unc

Enterprise-ready, privacy-first ChatGPT platform
https://unc.de
GNU Affero General Public License v3.0
7 stars 1 forks source link

[Bug] Wrong context is sent using an URL document after the second message #7

Closed marcusschiesser closed 8 months ago

marcusschiesser commented 11 months ago

Using URL documents, after the second message, the wrong messages are sent to the LLM.

The first message is sending the correct message to summarize the content: image

But the second message is sending urlDetail.url instead of sending the whole document as a message (urlDetail.content): image

marcusschiesser commented 10 months ago

Thinking about this again, if we add the whole document to the context, we are quickly reaching the limit of it for the models with smaller context size. Probably better to store the documents in a vector store (see #22)

marcusschiesser commented 8 months ago

fixed in https://github.com/marcusschiesser/unc-llamaindex