search

jacoblee93 / fully-local-pdf-chatbot

Yes, it's another chat over documents implementation... but this one is entirely local!
https://webml-demo.vercel.app
MIT License
1.68k stars 307 forks source link

Use AI-Mask within Worker #19

Open pacoccino opened 8 months ago

pacoccino commented 8 months ago

Replacing previous PR https://github.com/jacoblee93/fully-local-pdf-chatbot/pull/16

Simple modificiation to support AI-Mask extension as a model provider

I have somehow managed to communicate with the extension from within the web worker, so the computation is not blocking anymore.

Deployed here: https://fully-local-pdf-chatbot-topaz.vercel.app/

TODO:

vercel[bot] commented 8 months ago

Someone is attempting to deploy a commit to a Personal Account owned by @jacoblee93 on Vercel.

@jacoblee93 first needs to authorize it.

jacoblee93 commented 7 months ago

Hey really sorry, I got very busy this weekend. I will look as soon as I am able!

jacoblee93 commented 7 months ago

Thank you so much for this!

I downloaded and installed the extension but seem to be getting this:

Screenshot 2024-03-31 at 11 31 12 AM

Am I missing some setup step?

jacoblee93 commented 7 months ago

Overall this looks fantastic!!!

I can make all the changes I've brought up - the bigger problem is that I just can't seem to run the extension 😅

Am I missing a step?

pacoccino commented 7 months ago

Hey also sorry for the delay, just got back on this. I went through your comments and fixed most of it. My code was mostly a first throw for a working demo with workers. About the error you got running the extension, it’s because of some workarounds with WebGPU I use, if you open the extension first and reload the web page it should work. This will get better with Chrome release 124.

I’m actually wondering if there’s really something about this extension, compared to ollama, and if it’s worth continuing efforts. I’d love to hear your take on what such an extension could have that something like ollama won’t.