search

danswer-ai / danswer

Gen-AI Chat for Teams - Think ChatGPT if it had access to your team's unique knowledge.
https://docs.danswer.dev/
Other
10.37k stars 1.25k forks source link

Citations are sometimes wrong #1543

Open imqueralt opened 4 months ago

imqueralt commented 4 months ago

Sometimes the citations reference files that are not relevant to the query or make up citations.

The expected behaviour would be to have only the relevant and correct documents appear in the citations.

danswer_debug2 danswer_debug1

Note how we have references to [5,7], when there's only documents [1, 2, 3, 4] in the sources.

I have had cases where the citations are also mistaken. The response has a citation of document X and then the sources show document Y instead of document X.

errban commented 3 months ago

+1

sbelenki commented 2 months ago

Same here. Was testing Danswer on one connected document source (with one document to reference) and got 26 rows in the results, some of which were duplicated, with references to non-existing documents [2]...[11]. Not sure how this's even possible when there is only one document to start with.