av / harbor

Effortlessly run LLM backends, APIs, frontends, and services with one command.
https://github.com/av/harbor
Apache License 2.0
483 stars 28 forks source link

Perplexica UI doesn't terminate initialization #70

Open PieBru opened 6 days ago

PieBru commented 6 days ago

Hi, Trying Perplexica, it installs without errors, but the UI is stuck before writing its "prompt". It seems its settings must be adjusted, but also the settings page remains stuck waiting with the UPLOAD button disabled: image

It seems also that Perplexica doesn't take advantage of the Harbor ecosystem (Ollama, SearXNG).

I got Perplexica working in a dedicated LXC container after setting its config.toml before starting it:

[API_KEYS]
GROQ = "gsk_******"

[API_ENDPOINTS]
OLLAMA = "http://10.4.0.100:11434"
SEARXNG = "http://10.4.0.105:4000"

The only harbor config I'm aware of is this:

[root@HarborAI ~]# harbor config ls | grep -i perplexica
PERPLEXICA_HOST_PORT           34041
PERPLEXICA_BACKEND_HOST_PORT   34042

How to solve? Thank you

av commented 2 days ago

Thanks for the report, it's not an expected state, since Perplexica should:

Unfortunately, Perplexica is one of the services that are a tiny bit "picky" in terms of configuration, I've outlined some most possible caveats here: https://github.com/av/harbor/issues/60#issuecomment-2411864309


The only harbor config I'm aware of

Perplexica (and many other services) cross-connections are setup with cross-service files (I call them x files, haha), here's one for Ollama and another one for SearXNG, these are merged with the rest of the configs whenever harbor sees that matching services are run together (including default services). So one of the things to check is to verify if values in these files match the expected network layout.

nullnuller commented 20 hours ago

I still have the same issue https://github.com/av/harbor/issues/60#issuecomment-2411864309 Also, I noticed that perplexica config survives rm -rf harbor or even harbor config reset