brave / brave-browser

Brave browser for Android, iOS, Linux, macOS, Windows.
https://brave.com
Mozilla Public License 2.0
17.9k stars 2.34k forks source link

Allow for Ollama models to use Brave Search #41255

Open nonetrix opened 1 month ago

nonetrix commented 1 month ago

Platforms

all

Description

I was really surprised to see Ollama support was already added, however it seems that local models cannot search the web at all or it isn't working on my end. I would imagine it would just need to search and return the results to the local model maybe using a embedding model for retrieval and function calling. I already have a system like this actually working with Page Assist but Brave seems to detect it as bot pretty quickly lol so Duckduckgo it is. I'm sure using Brave would let me get around this though, but it doesn't seem to be working with Ollama

image

nonetrix commented 1 month ago

And btw Ollama supports embedding models, I use snowflake-arctic-embed who knows if it's the best but it's biggest so maybe.... Idk. Besides it not supporting search seems as good as Page Assist but with a better UI tbh