search

Future-House / paper-qa

High accuracy RAG for answering questions from scientific documents with citations
Apache License 2.0
6.23k stars 586 forks source link

How well does paper-qa work with full Zotero libraries? #452

Open mretier opened 1 month ago

mretier commented 1 month ago

Hi, I'm curious to give paper-qa a try. Before spending time playing around with I have a couple of questions that can maybe be answered easily.

  1. Will this work, in principle, with a Zotero database of about 2000 papers?
  2. If I understand it correctly, the embeddings are done by OpenAI. Would embedding this many papers be a big cost factor?

Thanks a lot for the info.

Cheers, Michael

jamesbraza commented 4 weeks ago

Hi @mretier I was using an index that started from a local folder of 5.5k papers yesterday, so it can work.

Would embedding this many papers be a big cost factor?

Let me get back to you on this, I don't recall what the cost was for me to make the index. If you provide a manifest file, it will decrease API calls as we won't try to infer the paper title