brave / brave-browser

Brave browser for Android, iOS, Linux, macOS, Windows.
https://brave.com
Mozilla Public License 2.0
17.96k stars 2.35k forks source link

Assistant/Leo AI ollama support should allow non-localhost http connections #41190

Open dictvm opened 2 months ago

dictvm commented 2 months ago

Platforms

all

Description

Since about July Brave Assistant/Leo AI supports setting up selfhosted Ollama to use a broad selection of open source models. Currently users cannot configure Ollama without https unless it is running on localhost.

I would appreciate allowing ollama API access via plaintext http for the following networks:

RFC1918:

RFC6598:

I’m using tailscale to access my ollama server remotely. I don’t want to deal with having a publicly available domain to get a Letsencrypt certificate since tailscale is already setting up an encrypted Wireguard tunnel between my devices.

Even without tailscale or similar tunneling software, I think a warning about using http over insecure networks should suffice. Someone running Ollama most likely is at least somewhat technically capable.

Secris commented 1 month ago

I have the exact same setup (local ollama server and tailscale vpn on all my devices) and would also like this feature.

darkitechtor commented 2 weeks ago

+1 I would appreciate it too if you added this feature! I have the same setup as other users, btw.

jonathansampson commented 1 week ago

Coming soon: https://github.com/brave/brave-core/pull/26475