[BUG] Duplicate responses

[mahmoudsorf]

Describe the bug when I use, conversational retrieval QA chain => chain Tool => Open AI function agent OR conversational retrieval QA chain => chain Tool => conversational retrieval agent

I am getting duplicate answers.

[HenryHengZJ]

have you tried RetrievalQAChain -> ChainTool -> Agent? Or try turning on Return Direct on ChainTool

[jrcapicua]

I notice the same, using: MultiRetrievalQAChain => ChainTool => Open AI function agent.

I think the agent action and the chain tool response are being streamed in the agent answer.

[mahmoudsorf]

Yes I tried the function agent as well and getting the same duplication.

[SepuWeb]

Same problem here, using OpenAi Function Agent.

[HenryHengZJ]

Seems to work fine on my side using RetrievalQAChain -> ChainTool -> OpenAI Function Agent:

[segelmache]

Same error as well. It's happening, when having more than one chain tools as input for the agent.

[EgorZakharov97]

Same thing here

[HenryHengZJ]

for now, a temporary workaroound is to enable Return Direct

[Dakes]

Unfortunately, this is a big issue for me as well. Would the fix likely be relatively straight forward, or more complicated?

[mateusluizfb]

Same happening here, even with the Return Direct enabled:

What is happening is:

• ChatOpenAI is called by MultiPromptChain, returns a json containing the selected prompt
  • This output json is streamed back to the user chat
• ChatOpenAI is called a second time with the selected prompt
  • The answer is streamed back to the user chat as well

Something like this:

In the end, the final output is looking something like:

`json { "destination": "selected_prompt", "next_inputs": { "input": "prompt input" } }`Some answer to some question. 

I could send some screenshots, but all the text is mostly in Portuguese :/

[moymoussan]

Same here. I get duplicate responses after the tool agent uses a custom tool

[io4x]

I also get duplicate responses, but in two messages, where the message is completed.

[Ghazalsalameh]

@io4x did u manage to solve it ?

[moymoussan]

I noticed it happens on the embedded chat but not in the built in chat of the flow editor

[io4x]

@Ghazalsalameh & @moymoussan - Aman soni was able to idenfity the fix. Resolve will come in the next few days!

https://discord.com/channels/1087698854775881778/1267529485893238935/1268953277400088626

[HenryHengZJ]

should be resolved with https://github.com/FlowiseAI/FlowiseChatEmbed/pull/221