mukulpatnaik / researchgpt

A LLM based research assistant that allows you to have a conversation with a research paper
https://www.dara.chat
MIT License
3.55k stars 340 forks source link

Demo provided in the README.md, when asked about the loaded paper, provides answers from other paper. #12

Closed cristisulighetean closed 1 year ago

cristisulighetean commented 1 year ago

The first couple of times it worked as expected, then it started to misbehave and provided answers about totally different papers.

Browser used: Safari, version 15.6.1 (17613.3.9.1.16)

image

mukulpatnaik commented 1 year ago

Hi @cristisulighetean this is interesting, I'm not exactly sure why this would happen. One explanation could be that due to multiple people using the demo at the same time, the backend might be getting things mixed up (although this shouldn't be the case since I have updated all calls to be made from the browser.)

Would you mind trying to do this with the same paper again and try to reproduce this bug? Also would you mind checking if the sources listed in light grey below the message are from the same paper or a different paper? Thanks :)

cristisulighetean commented 1 year ago

I have now used the tool for multiple days and was not able to replicate the previous posted issue.