Authentication needed for URL

AugustDev / enchanted

Enchanted is iOS and macOS app for chatting with private self hosted language models such as Llama2, Mistral or Vicuna using Ollama.

Apache License 2.0

3.16k stars 188 forks source link

Authentication needed for URL #141

Open Josh-E-S opened 1 month ago

Josh-E-S commented 1 month ago

I have the app up and working with ngrok and it's working great, but anyone that has my URL can hit my ollama server unchecked. I see the option for a bearer token. Can you expand on how this can be used for authentication? I don't see anything in the Readme.

tjmustard commented 1 month ago

I am looking into this myself. I see this project (https://github.com/stephan-buckmaster/ruby-bearer-auth-proxy) as a solution, but I am hoping for Ollama to support this natively, or configure my nginx to do this. If someone figures this out, please post a solution here.

tjmustard commented 1 month ago

There is llamatunnel.com or https://github.com/mitja/llamatunnel