lifan0127
commented
1 year ago Hi @huachuman Thanks for your time and feedback! Some of the known limitations and their root causes were summarized in README: https://github.com/lifan0127/ai-research-assistant#limitations.
To sum things up, my current impression is that the assistant has limited ability to both find and generate useful information, and often fails unless provided with highly specific queries such as copy pasting those in the example, but not slightly modified versions.
I would appreciate if you could share the specific questions you used which can be very helpful for troubleshooting.
As an aside, does this search through the full texts or just the metadata and abstract?
The search is based on full-text.
It doesn't seem to be able to summarize anything. Sometimes it tells me it doesn't have access to the zotero database yet other times it seems to pull information from it.
This has occasionally happened to me too, even though I have had the following statement in the system prompt: "Assistant is able to access user's Zotero database and can search for items in the database."
I am running into quite a few issues. I am debating whether I should write an extensive post about them or whether I should just wait for updates. I don't have much time but would be willing to help troubleshoot.
To sum things up, my current impression is that the assistant has limited ability to both find and generate useful information, and often fails unless provided with highly specific queries such as copy pasting those in the example, but not slightly modified versions.
As an aside, does this search through the full texts or just the metadata and abstract?
It doesn't seem to be able to summarize anything. Sometimes it tells me it doesn't have access to the zotero database yet other times it seems to pull information from it.