search

wandb / openui

OpenUI let's you describe UI using your imagination, then see it rendered live.
https://openui.fly.dev
Apache License 2.0
16.81k stars 1.47k forks source link

Ollama integration not working and Groq not responding #132

Open Himanshu-369 opened 1 month ago

Himanshu-369 commented 1 month ago

Tried the previous solution pip uninstall openui pip install .

still the issue is same, now even the ollama integration is not working and the GROQ_BASE_URL , GROQ_API_KEY makes no sense, because its making no change

Himanshu-369 commented 1 month ago

Ollama is also not working set the api key to set OPENAI_API_KEY = xxx started the ollama its up & running on port 11434, but not showing the model name in the openui

Attached Screenshots :: image image image

SFARPak commented 1 month ago

You need to pull some model to make Ollama appear.

ollama pull llama2

after pulling rerun the server

Himanshu-369 commented 1 month ago

You need to pull some model to make Ollama appear.

ollama pull llama2

after pulling rerun the server

Bro are you kidding I have models installed, someone would be an idiot if he is using ollama without models downloaded

SFARPak commented 1 month ago

Its not discord or Facebook someone would be Idiot kidding on GitHub. Which OS you are working on? Please send the snapshot of both Ollama running and models dropdown in OpenUI.

vanpelt commented 1 month ago

@Himanshu-369 it looks you don't have the most recent changes. The UI is making a request to /v1/ollama/tags that's been replaced with /v1/models on the main branch. I just pushed some new changes to main and upgraded the version. Try pulling again re-installing. If you check your chrome inspector window on the network tab you'll find /v1/models and the response should contain a list of ollama models that are running.

Screenshot 2024-05-20 at 4 40 10 PM

P.S. I agree with @SFARPak. The tone in the previous message rubbed me the wrong way. We're all trying to help here, let's tone it down 🙏

Himanshu-369 commented 1 month ago

I want to apologize for the tone in my previous message. It was not my intention to come across as harsh or disrespectful to anyone @SFARPak @vanpelt . I appreciate all the efforts everyone is putting in to help and collaborate.

SFARPak commented 1 month ago

I want to apologize for the tone in my previous message. It was not my intention to come across as harsh or disrespectful to anyone @SFARPak @vanpelt . I appreciate all the efforts everyone is putting in to help and collaborate.

No worries did you get to solve the issue? I was asking you OS because on Windows environment variables are not working correctly, so you will need to install another package called python-decouple.

python -m pip install python-decouple