search

quarkiverse / quarkus-langchain4j

Quarkus Langchain4j extension
https://docs.quarkiverse.io/quarkus-langchain4j/dev/index.html
Apache License 2.0
115 stars 64 forks source link

Dev UI: Allow RAG and tools together with streaming #689

Closed jmartisk closed 1 week ago

jmartisk commented 1 week ago

Rag> rag

Tools> tools

jmartisk commented 1 week ago

There's a slight problem here that streaming is always executed on the event loop, so it blows up if some of the tools are blocking. Need to figure out how to properly solve this.

jmartisk commented 1 week ago

There's a slight problem here that streaming is always executed on the event loop, so it blows up if some of the tools are blocking. Need to figure out how to properly solve this.

ok this should be fixed, I'm not sure if there's a better solution but I just added an assumption that tools and retrieval augmentors are blocking and should execute on a worker thread

jmartisk commented 1 week ago

Merging it, next I'd like to support images and do some more refactoring, the code of the page is getting really ugly