search

AugustDev / enchanted

Enchanted is iOS and macOS app for chatting with private self hosted language models such as Llama2, Mistral or Vicuna using Ollama.
Apache License 2.0
3.65k stars 218 forks source link

model choice is visible but endpoint unreachable #100

Open theoden8 opened 6 months ago

theoden8 commented 6 months ago

Hi there,

Thank you for a wonderful piece of software, it has a very friendly interface and a great take on usability.

I am using ollama with ollama_proxy_server and I see / requests every 5 seconds (it is spamming in the logs) but the completion request is not visible. This proxy works fine with some other GUI software for LLMs. Model selection is detected.

On MacOS:

SCRSH 2024-05-02 um 22 18 35

On iOS:

7C43B736-2402-4577-93FB-5A0AB5B21D1F

ollama_proxy_server logs:

127.0.0.1 - -  "GET /api/tags HTTP/1.0" - -
127.0.0.1 - -  "GET /api/tags HTTP/1.0" 200 -
127.0.0.1 - -  code 501, message Unsupported method ('HEAD')
127.0.0.1 - -  "HEAD / HTTP/1.0" 501 -
127.0.0.1 - -  code 501, message Unsupported method ('HEAD')
127.0.0.1 - -  "HEAD / HTTP/1.0" 501 -
127.0.0.1 - -  code 501, message Unsupported method ('HEAD')
127.0.0.1 - -  "HEAD / HTTP/1.0" 501 -
AugustDev commented 6 months ago

Thanks for sharing, I will investigate!

theoden8 commented 6 months ago

/api/tags is not authenticated, it seems, if that's any help.