Quansight / ragna

RAG orchestration framework ⛵️
https://ragna.chat
BSD 3-Clause "New" or "Revised" License
167 stars 21 forks source link

serve the web UI thorugh FastAPI #416

Closed pmeier closed 2 weeks ago

pmeier commented 1 month ago

Feature description

Per title. Roughly speaking this means replacing

https://github.com/Quansight/ragna/blob/0cb205f24ca9fb322ac32a2e1aaec6b34928cd2e/ragna/deploy/_ui/app.py#L132

with uvicorn.run.

Value and/or benefit

panel by default runs on a tornado web server. Our REST API is handled by FastAPI. Thus, to deploy Ragna one always needs to spin up two web servers. In our current setup they even need to communicate with each other through HTTP (see #392), which brings a whole set of different issues with it.

Having both the REST API and web UI served by the same type of web server is the first step towards serving both from the same web server.

Anything else?

No response