search

FlowiseAI / Flowise

Drag & drop UI to build your customized LLM flow
https://flowiseai.com
Apache License 2.0
29.92k stars 15.45k forks source link

[BUG] SSE Streaming Bugs for multiple tools #3222

Open hahl9000 opened 7 hours ago

hahl9000 commented 7 hours ago

Describe the bug When using chains as tools the new version streams both an answer that tool 1 doesnt know and then streams tool 2 answer. It doesnt adhere to my system prompt anymore.

To Reproduce Steps to reproduce the behavior:

  1. Create 2 tools from flows. One that doesnt know and one which does.
  2. Ask it to always use tool 1 first. If tool 1 doesnt know then use tool 2.
  3. Embed to a page, ask questions that tool 2 knows and then it will stream both that it doesnt know and right after the answer.
  4. See output.

Expected behavior To be able to sort out the answer that doesnt know. Prompt adherence seems off and it worked great in previous version.

Screenshots If applicable, add screenshots to help explain your problem.

Flow If applicable, add exported flow in order to help replicating the problem.

Setup

Additional context Worked better in previous version. Creates a problem with to flowtools that should complement each other.

HenryHengZJ commented 5 hours ago

Do you have an example chatflow we can use to replicate?

hahl9000 commented 4 hours ago

No, I've looked into it and from what I can see, even though its a bit laggy the test chat concatenates the answer and remove the streaming answer from the tool that doesn't know. I'm thinking this could be an issue with the latest embed instead?