Open bsorrentino opened 1 month ago
Hi, is there any progress on this issue? Or, if a non-serializable object needs to be injected into a node in Worflows, such as WebSocket, SseEmitter, etc., which are all non-serializable, but the content needs to be pushed to the outside in real time during the execution of the node, is there any other solution?
Hi, is there any progress on this issue? Or, if a non-serializable object needs to be injected into a node in Worflows, such as WebSocket, SseEmitter, etc., which are all non-serializable, but the content needs to be pushed to the outside in real time during the execution of the node, is there any other solution?
Hi @TyCoding Currently to implement such feature we have to consider that :
NodeAction
should be able to return an AsyncIterator
.NodeAction
should accept another argument (ie RunnableConfig) to decide if or not use streaming as result.StreamingResponseHandler
.It is not so simple and, potentially, could break backward compatibility so I'm evaluating the best strategy before start implementation
@bsorrentino Thanks, looking forward to this feature
up
Related to this question in #30
Enable the possibility to use the langchain4j's
StreamingChatLanguageModel
instead ofChatLanguageModel