search

n4ze3m / page-assist

Use your locally running AI models to assist you in your web browsing
https://chromewebstore.google.com/detail/page-assist-a-web-ui-for/jfgfiigpkhlkbnfnbobbkinehhfdhndo
MIT License
1.23k stars 124 forks source link

Bug or [SUGGESTION] RAG document limit #151

Closed clickbrain closed 3 weeks ago

clickbrain commented 1 month ago

I fed a large number of markdown files into a RAG knowledge base, but it only seems to have processed 10 files. Is there a limit on the number of files for RAG or is this a bug of some kind?

n4ze3m commented 1 month ago

It is not a bug. I have added a limit because everything happens inside the browser, and I don't want to slow down the browser by processing a huge amount of files. I might add settings to update the limit; by default, I think it is 10

razvanab commented 1 month ago

So, this is why the extension seems to slow down with some documents added to the rag. I was about to add an issue for this.

clickbrain commented 1 month ago

OK. I am running browser on M3 with 36gb RAM and the LLM/Ollama is running on an M2 Studio with 64GB of Ram and processing text/markdown files. Would love the option to set the number of files or have unlimited and see how it does.

n4ze3m commented 1 month ago

Hey, you can now increase the file limit from the RAG settings

image

clickbrain commented 1 month ago

Awesome! Thank you!