search

thiswillbeyourgithub / wdoc

Summarize and query from a lot of heterogeneous documents. Any LLM provider, any filetype, scalable, under developpement
GNU General Public License v3.0
139 stars 12 forks source link

Integrate with Open-WebUI #4

Open parthpat12 opened 1 month ago

parthpat12 commented 1 month ago

Can this be used as "Pipe" in Open-WebUI front?

thiswillbeyourgithub commented 1 month ago

Hi, this is definitely the plan. But the issue is that you can't have external dependencies in a pipe or in a function, so it has to be a pipeline. Or another possibility would be to make my project fit inside a Docker container and expose an API that could be accessed as a tool from an LLM.

Either way, it shouldn't be too difficult but would probably be best done after I reworked some parts of the code to enhance the UI of this project. Right now the workflow for CLI is pretty awkward in my opinion. One additional benefit would be to wait for pipelines and open WebUI to become more stable.

I have to say I'm quite bullish on the pipelines overall.

If for some reason you are in a hurry, you could make it work quite quickly by taking a look at my examples. Maybe the ntfy one. Then write a fastAPI endpoint. Then add a loop. Then write a open WebUI function that calls this endpoint. I'm thinking both should be under 200 lines of code combined.

Interested?