n4ze3m / page-assist

Use your locally running AI models to assist you in your web browsing
https://chromewebstore.google.com/detail/page-assist-a-web-ui-for/jfgfiigpkhlkbnfnbobbkinehhfdhndo
MIT License
1.56k stars 148 forks source link

Page RAG much worse in Brave compared to Firefox #234

Open nonetrix opened 2 weeks ago

nonetrix commented 2 weeks ago

Not sure why but RAG is much worse in Firefox than Brave

Firefox: satty-20241103-18:58:45

Brave: satty-20241103-18:58:41

I made sure I had the same model and settings on both, not sure what is causing the difference. Perhaps some privacy setting Brave has or Manifest v3

n4ze3m commented 2 weeks ago

Try turning off the 'Chat with website using vector embeddings' setting for summarizing; it will work much better than RAG-based methods. Also, I think you may have turned it off in Firefox, which is why it's giving higher-quality response

image

image

nonetrix commented 2 weeks ago

It was enabled in Firefox too oddly, doesn't seem to have much of a effect really. I am not sure how RAG exactly works, but can I get raw text that's passed to the model perhaps to debug? Also, seemingly I haven't had issue with it really