[streaming output] Support for ComfyUI LLM node in BizyAir

siliconflow / BizyAir

BizyAir: Comfy Nodes that can run in any environment.

https://siliconflow.github.io/BizyAir/

MIT License

339 stars 20 forks source link

[streaming output] Support for ComfyUI LLM node in BizyAir #78

Closed Bobbyztz closed 2 months ago

Bobbyztz commented 3 months ago

Hi, I'm also working on building LLMs-centered node in ComfyUI, like Dify/Coze in ComfyUI. Is it possible to support streaming output for LLMs nodes?

Seems like the non-Asynchronous feature of ComfyUI doesn't allow us to do that.

doombeaker commented 2 months ago

Thank you for your suggestion. I think stream output is a very practical feature. I assume it can be achieved under the ComfyUI framework by handling it in the js plugin code. However, I'm not certain and need to practice writing frontend js in ComfyUI. Due to plans for other features, we will not be working on this particular feature in the short term. If you are interested or make any progress, feel free to share.