codeforequity-at / botium-core

The Selenium for Chatbots - Bots Testing Bots
https://www.botium.ai
MIT License
229 stars 64 forks source link

synchronized from a convo file #340

Closed hunkim closed 5 years ago

hunkim commented 5 years ago

Describe the bug When botium-cli sens messages to a chatbot, it seems it send two (or messages) simultaneously. (or send the next message before it gets a message from a bot.)

As a result, the bot is not working properly.

To Reproduce Steps to reproduce the behavior.

Expected behavior A clear and concise description of what you expected to happen.

Screenshots image

This is a history using botium-cli. (It seems it sends Sung, k12345, ok simultaneously.)

This a manual testing which works properly. image

Desktop (please complete the following information):

Additional context Not sure it's a problem of Dialogflow.

Or simply can we add sleep between two messages?

codeforequity-at commented 5 years ago

what does your convo file look like ?

hunkim commented 5 years ago

Here we are:

Test
#me
what is my mid-term score?
#me
Sung
#me
k12345
#me
ok
hunkim commented 5 years ago

Or this:

Test
#me
what is my mid-term score?

#bot

#me
Sung

#bot

#me
k12345

#bot

#me
ok

#bot
codeforequity-at commented 5 years ago

Depending on the convo structure, Botium sends to the bot or waits for the bot's answer. Your convo files are fine. Can you please enable the --verbose switch and attach the log output here (mask your api keys in the log output please).

hunkim commented 5 years ago

I will post the log soon.

BTW is there any way to force botium to waits for the bot's answer?

Thanks.

On Thu, 1 Aug 2019 at 5:54 PM Botium notifications@github.com wrote:

Depending on the convo structure, Botium sends to the bot or waits for the bot's answer. Your convo files are fine. Can you please enable the --verbose switch and attach the log output here (mask your api keys in the log output please).

— You are receiving this because you authored the thread. Reply to this email directly, view it on GitHub https://github.com/codeforequity-at/botium-core/issues/340?email_source=notifications&email_token=AAG4GV3GUK5HKOGTGPVQIE3QCKQDRA5CNFSM4IILPM3KYY3PNVWWK3TUL52HS4DFVREXG43VMVBW63LNMVXHJKTDN5WW2ZLOORPWSZGOD3J33SA#issuecomment-517193160, or mute the thread https://github.com/notifications/unsubscribe-auth/AAG4GVZ7O7JAE5YYUIDI3Q3QCKQDRANCNFSM4IILPM3A .

codeforequity-at commented 5 years ago

For dialogflow, it is a synchronous API call to the Dialogflow API, so Botium implicitly waits for the bot's answer - there is no such thing as a bot-triggered message with Dialogflow.

hunkim commented 5 years ago

Hmm.

Botium implicitly waits for the bot's answer

Then, it does not make sense in my case. I'll post the log soon.

Sung

On Thu, Aug 1, 2019 at 7:37 PM Botium notifications@github.com wrote:

For dialogflow, it is a synchronous API call to the Dialogflow API, so Botium implicitly waits for the bot's answer - there is no such thing as a bot-triggered message with Dialogflow.

— You are receiving this because you authored the thread. Reply to this email directly, view it on GitHub https://github.com/codeforequity-at/botium-core/issues/340?email_source=notifications&email_token=AAG4GV4WHAULJJIKESLW5NTQCLDGRA5CNFSM4IILPM3KYY3PNVWWK3TUL52HS4DFVREXG43VMVBW63LNMVXHJKTDN5WW2ZLOORPWSZGOD3KI5CQ#issuecomment-517246602, or mute the thread https://github.com/notifications/unsubscribe-auth/AAG4GV6HVNFSUH26SJRDDQDQCLDGRANCNFSM4IILPM3A .

codeforequity-at commented 5 years ago

Then, it does not make sense in my case. I'll post the log soon. Sung

I think the problem in your case is related to context handling - the logs will help me in analyzing this ...

hunkim commented 5 years ago

Attached!

Thanks for your help.

debug.log

codeforequity-at commented 5 years ago

Cannot spot anything unusual from the logfile. When sending the "k12345" id, in dialogflow again triggers the "exam_score_enquery - ask_name" intent, replacing the name slot with the id. Would it be possible to export your dialogflow agent and send it to me ? (if not here on github, then by email florian.treml "at" botium.at).

stale[bot] commented 5 years ago

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions.