search

open-webui / open-webui

User-friendly WebUI for AI (Formerly Ollama WebUI)
https://openwebui.com
MIT License
41.28k stars 4.87k forks source link

feat: openai compatible tool usage #4436

Open CookSleep opened 1 month ago

CookSleep commented 1 month ago

Is your feature request related to a problem? Please describe. I instructed the model to use a Tool to obtain search engine results, and attempted to have the model call the Tool again after reviewing the search result text returned by the Tool, in order to read the content of specific search result links. However, currently Open WebUI only allows one Tool call per model output, which is quite frustrating...

Describe the solution you'd like Allow the model to call functions multiple times in a single output

Describe alternatives you've considered Making multiple requests, but that only makes searching more of a hassle!

Additional context I know some folks might recommend I use Reader's search engine, but honestly, I feel the quality of content it retrieves is just so-so, and the diversity doesn't really meet my expectations... Plus, I'm sure there are tons of use cases where models need to call functions multiple times in one output.

justinh-rahb commented 1 month ago

I believe @michaelpoluektov has been pushing for adding support for this as well. I don't recall if he's already started an issue or PR for it, but he can chime in his thoughts either way.

michaelpoluektov commented 1 month ago

I started an issue but no PR yet. Adding this requires quite a major refactor, and I'll most likely submit a draft this weekend. Issue tracked here:

https://github.com/open-webui/open-webui/issues/4219

lee-b commented 1 month ago

FYI, LocalAI implements the required backend API locally: https://localai.io/features/openai-functions/