Closed Pratiksha1312 closed 4 years ago
Hey @Pratiksha1312 sorry for the late response was pretty busy the past few days. I'm going to look into this now and see if I can reproduce it.
Do you have logs on this from say doing rasa shell --debug
that you can post as well?
Also do you have the template reference for utter_restart_with_button
so I can see what that is doing.
Thanks
hello @Pratiksha1312 just checking back again to see if you have the logs from this and the other items I mentioned in the previous comment?
reproducible on https://github.com/RasaHQ/rasa-demo. To reproduce:
> confirm@0.75
> /out_of_scope
> confirm@0.75
> /out_of_scope
> /restart
restart is predicted by the mapping policy, but because two stage fallback predicts action_listen, and it has higher priority, restart is not correctly executed.
@erohmensing when trying to reproduce, I am presented with a /restart option twice in a row, but it works the second time it is selected. Is that the same behaviour you were seeing?
Hm, I don't think so. I've also seen the regular restart button from action_default_fallback
not work as well. Can you post the debug logs from a conversation? We have noticed it specifically in Sara
I don't see an intent confirm
in the domain of Sara (incl. the version of master on 5 Nov) - should I be on some other branch?
This is on Sara on the current master branch -
Your input -> /affirm@0.75
2020-01-15 17:14:03 DEBUG rasa.core.tracker_store - Creating a new tracker for id 'default'.
2020-01-15 17:14:03 DEBUG rasa.core.processor - Starting a new session for conversation ID 'default'.
2020-01-15 17:14:03 DEBUG rasa.core.processor - Action 'action_session_start' ended with events '[<rasa.core.events.SessionStarted object at 0x15d955198>, <rasa.core.events.ActionExecuted object at 0x15d955160>]'.
2020-01-15 17:14:03 DEBUG rasa.core.processor - Current slot values:
budget: None
business_email: None
can_use_spacy: None
company: None
current_api: None
email: None
entity_extractor: None
feedback_message: None
feedback_value: None
job_function: None
language: None
name: None
nlu_part: None
onboarding: None
person_name: None
problem_description: None
product: None
requested_slot: None
shown_privacy: None
step: None
suggestion: None
unknown_nlu_part: None
unknown_product: None
use_case: None
2020-01-15 17:14:03 DEBUG rasa.core.processor - Received user message '/affirm@0.75' with intent '{'name': 'affirm', 'confidence': 0.75}' and entities '[]'
2020-01-15 17:14:03 DEBUG rasa.core.processor - Logged UserUtterance - tracker now has 4 events.
2020-01-15 17:14:04 DEBUG rasa.core.policies.memoization - Current tracker state [None, None, None, None, {}, {'prev_action_listen': 1.0, 'intent_affirm': 1.0}]
2020-01-15 17:14:04 DEBUG rasa.core.policies.memoization - Launch DeLorean...
2020-01-15 17:14:04 DEBUG rasa.core.policies.memoization - Current tracker state [None, None, None, None, {}, {'prev_action_listen': 1.0, 'intent_affirm': 1.0}]
2020-01-15 17:14:04 DEBUG rasa.core.policies.memoization - There is no memorised next action
2020-01-15 17:14:04 DEBUG rasa.core.policies.fallback - NLU confidence 0.75 is lower than NLU threshold 0.80.
2020-01-15 17:14:04 DEBUG rasa.core.policies.two_stage_fallback - User 'default' has to affirm intent 'affirm'.
2020-01-15 17:14:04 DEBUG rasa.core.policies.form_policy - There is no active form
2020-01-15 17:14:04 DEBUG rasa.core.policies.ensemble - Predicted next action using policy_2_TwoStageFallbackPolicy
2020-01-15 17:14:04 DEBUG rasa.core.processor - Predicted next action 'action_default_ask_affirmation' with confidence 1.00.
2020-01-15 17:14:04 DEBUG rasa.core.actions.action - Calling action endpoint to run action 'action_default_ask_affirmation'.
2020-01-15 17:14:04 DEBUG rasa.core.processor - Action 'action_default_ask_affirmation' ended with events '[BotUttered('Sorry, I'm not sure I've understood you correctly π€ Do you mean...', {"elements": null, "quick_replies": null, "buttons": [{"title": "Yes", "payload": "/affirm{}"}, {"title": "Something else", "payload": "/out_of_scope"}], "attachment": null, "image": null, "custom": null}, {}, 1579104844.25521)]'.
2020-01-15 17:14:04 DEBUG rasa.core.processor - Current slot values:
budget: None
business_email: None
can_use_spacy: None
company: None
current_api: None
email: None
entity_extractor: None
feedback_message: None
feedback_value: None
job_function: None
language: None
name: None
nlu_part: None
onboarding: None
person_name: None
problem_description: None
product: None
requested_slot: None
shown_privacy: None
step: None
suggestion: None
unknown_nlu_part: None
unknown_product: None
use_case: None
2020-01-15 17:14:04 DEBUG rasa.core.policies.memoization - Current tracker state [None, None, None, {}, {'prev_action_listen': 1.0, 'intent_affirm': 1.0}, {'prev_action_default_ask_affirmation': 1.0, 'intent_affirm': 1.0}]
2020-01-15 17:14:04 DEBUG rasa.core.policies.memoization - Launch DeLorean...
2020-01-15 17:14:04 DEBUG rasa.core.policies.memoization - Current tracker state [None, None, None, None, {}, {'prev_action_default_ask_affirmation': 1.0}]
2020-01-15 17:14:04 DEBUG rasa.core.policies.memoization - There is no memorised next action
2020-01-15 17:14:04 DEBUG rasa.core.policies.form_policy - There is no active form
2020-01-15 17:14:04 DEBUG rasa.core.policies.mapping_policy - There is no mapped action for the predicted intent, 'affirm'.
2020-01-15 17:14:04 DEBUG rasa.core.policies.ensemble - Predicted next action using policy_2_TwoStageFallbackPolicy
2020-01-15 17:14:04 DEBUG rasa.core.processor - Predicted next action 'action_listen' with confidence 1.00.
2020-01-15 17:14:04 DEBUG rasa.core.processor - Action 'action_listen' ended with events '[]'.
2020-01-15 17:14:04 DEBUG rasa.core.lock_store - Deleted lock for conversation 'default'.
? Sorry, I'm not sure I've understood you correctly π€ Do you mean... 2: Something else (/out_of_scope)
2020-01-15 17:14:08 DEBUG rasa.core.tracker_store - Recreating tracker for id 'default'
2020-01-15 17:14:08 DEBUG rasa.core.processor - Received user message '/out_of_scope' with intent '{'name': 'out_of_scope', 'confidence': 1.0}' and entities '[]'
2020-01-15 17:14:08 DEBUG rasa.core.processor - Logged UserUtterance - tracker now has 8 events.
2020-01-15 17:14:08 DEBUG rasa.core.policies.memoization - Current tracker state [None, None, {}, {'prev_action_listen': 1.0, 'intent_affirm': 1.0}, {'prev_action_default_ask_affirmation': 1.0, 'intent_affirm': 1.0}, {'intent_out_of_scope': 1.0, 'prev_action_listen': 1.0}]
2020-01-15 17:14:08 DEBUG rasa.core.policies.memoization - Launch DeLorean...
2020-01-15 17:14:08 DEBUG rasa.core.policies.memoization - Current tracker state [None, None, None, None, {}, {'intent_out_of_scope': 1.0, 'prev_action_listen': 1.0}]
2020-01-15 17:14:08 DEBUG rasa.core.policies.memoization - There is a memorised next action '163'
2020-01-15 17:14:08 DEBUG rasa.core.policies.two_stage_fallback - User 'default' denied suggested intents.
2020-01-15 17:14:08 DEBUG rasa.core.policies.form_policy - There is no active form
2020-01-15 17:14:08 DEBUG rasa.core.policies.ensemble - Predicted next action using policy_2_TwoStageFallbackPolicy
2020-01-15 17:14:08 DEBUG rasa.core.processor - Predicted next action 'action_default_ask_rephrase' with confidence 1.00.
2020-01-15 17:14:08 DEBUG rasa.core.processor - Action 'action_default_ask_rephrase' ended with events '[]'.
2020-01-15 17:14:08 DEBUG rasa.core.processor - Current slot values:
budget: None
business_email: None
can_use_spacy: None
company: None
current_api: None
email: None
entity_extractor: None
feedback_message: None
feedback_value: None
job_function: None
language: None
name: None
nlu_part: None
onboarding: None
person_name: None
problem_description: None
product: None
requested_slot: None
shown_privacy: None
step: None
suggestion: None
unknown_nlu_part: None
unknown_product: None
use_case: None
2020-01-15 17:14:08 DEBUG rasa.core.policies.memoization - Current tracker state [None, {}, {'prev_action_listen': 1.0, 'intent_affirm': 1.0}, {'prev_action_default_ask_affirmation': 1.0, 'intent_affirm': 1.0}, {'intent_out_of_scope': 1.0, 'prev_action_listen': 1.0}, {'prev_action_default_ask_rephrase': 1.0, 'intent_out_of_scope': 1.0}]
2020-01-15 17:14:08 DEBUG rasa.core.policies.memoization - Launch DeLorean...
2020-01-15 17:14:08 DEBUG rasa.core.policies.memoization - Current tracker state [None, None, None, None, {}, {'prev_action_default_ask_rephrase': 1.0}]
2020-01-15 17:14:08 DEBUG rasa.core.policies.memoization - There is no memorised next action
2020-01-15 17:14:08 DEBUG rasa.core.policies.form_policy - There is no active form
2020-01-15 17:14:08 DEBUG rasa.core.policies.mapping_policy - There is no mapped action for the predicted intent, 'out_of_scope'.
2020-01-15 17:14:08 DEBUG rasa.core.policies.ensemble - Predicted next action using policy_2_TwoStageFallbackPolicy
2020-01-15 17:14:08 DEBUG rasa.core.processor - Predicted next action 'action_listen' with confidence 1.00.
2020-01-15 17:14:08 DEBUG rasa.core.processor - Action 'action_listen' ended with events '[]'.
2020-01-15 17:14:08 DEBUG rasa.core.lock_store - Deleted lock for conversation 'default'.
? Sorry, I'm not sure I've understood you correctly π€ Do you mean... Type out your own message...
Your input -> /affirm@0.75
2020-01-15 17:14:15 DEBUG rasa.core.tracker_store - Recreating tracker for id 'default'
2020-01-15 17:14:15 DEBUG rasa.core.processor - Received user message '/affirm@0.75' with intent '{'name': 'affirm', 'confidence': 0.75}' and entities '[]'
2020-01-15 17:14:15 DEBUG rasa.core.processor - Logged UserUtterance - tracker now has 11 events.
2020-01-15 17:14:15 DEBUG rasa.core.policies.memoization - Current tracker state [{}, {'prev_action_listen': 1.0, 'intent_affirm': 1.0}, {'prev_action_default_ask_affirmation': 1.0, 'intent_affirm': 1.0}, {'intent_out_of_scope': 1.0, 'prev_action_listen': 1.0}, {'prev_action_default_ask_rephrase': 1.0, 'intent_out_of_scope': 1.0}, {'prev_action_listen': 1.0, 'intent_affirm': 1.0}]
2020-01-15 17:14:15 DEBUG rasa.core.policies.memoization - Launch DeLorean...
2020-01-15 17:14:15 DEBUG rasa.core.policies.memoization - Current tracker state [None, None, None, None, {}, {'prev_action_listen': 1.0, 'intent_affirm': 1.0}]
2020-01-15 17:14:15 DEBUG rasa.core.policies.memoization - There is no memorised next action
2020-01-15 17:14:15 DEBUG rasa.core.policies.fallback - NLU confidence 0.75 is lower than NLU threshold 0.80.
2020-01-15 17:14:15 DEBUG rasa.core.policies.two_stage_fallback - Ambiguous rephrasing of user 'default' for intent 'affirm'
2020-01-15 17:14:15 DEBUG rasa.core.policies.form_policy - There is no active form
2020-01-15 17:14:15 DEBUG rasa.core.policies.ensemble - Predicted next action using policy_2_TwoStageFallbackPolicy
2020-01-15 17:14:15 DEBUG rasa.core.processor - Predicted next action 'action_default_ask_affirmation' with confidence 1.00.
2020-01-15 17:14:15 DEBUG rasa.core.actions.action - Calling action endpoint to run action 'action_default_ask_affirmation'.
2020-01-15 17:14:15 DEBUG rasa.core.processor - Action 'action_default_ask_affirmation' ended with events '[BotUttered('Sorry, I'm not sure I've understood you correctly π€ Do you mean...', {"elements": null, "quick_replies": null, "buttons": [{"title": "Yes", "payload": "/affirm{}"}, {"title": "Something else", "payload": "/out_of_scope"}], "attachment": null, "image": null, "custom": null}, {}, 1579104855.49731)]'.
2020-01-15 17:14:15 DEBUG rasa.core.processor - Current slot values:
budget: None
business_email: None
can_use_spacy: None
company: None
current_api: None
email: None
entity_extractor: None
feedback_message: None
feedback_value: None
job_function: None
language: None
name: None
nlu_part: None
onboarding: None
person_name: None
problem_description: None
product: None
requested_slot: None
shown_privacy: None
step: None
suggestion: None
unknown_nlu_part: None
unknown_product: None
use_case: None
2020-01-15 17:14:15 DEBUG rasa.core.policies.memoization - Current tracker state [{'prev_action_listen': 1.0, 'intent_affirm': 1.0}, {'prev_action_default_ask_affirmation': 1.0, 'intent_affirm': 1.0}, {'intent_out_of_scope': 1.0, 'prev_action_listen': 1.0}, {'prev_action_default_ask_rephrase': 1.0, 'intent_out_of_scope': 1.0}, {'prev_action_listen': 1.0, 'intent_affirm': 1.0}, {'prev_action_default_ask_affirmation': 1.0, 'intent_affirm': 1.0}]
2020-01-15 17:14:15 DEBUG rasa.core.policies.memoization - Launch DeLorean...
2020-01-15 17:14:15 DEBUG rasa.core.policies.memoization - Current tracker state [None, None, None, None, {}, {'prev_action_default_ask_affirmation': 1.0}]
2020-01-15 17:14:15 DEBUG rasa.core.policies.memoization - There is no memorised next action
2020-01-15 17:14:15 DEBUG rasa.core.policies.form_policy - There is no active form
2020-01-15 17:14:15 DEBUG rasa.core.policies.mapping_policy - There is no mapped action for the predicted intent, 'affirm'.
2020-01-15 17:14:15 DEBUG rasa.core.policies.ensemble - Predicted next action using policy_2_TwoStageFallbackPolicy
2020-01-15 17:14:15 DEBUG rasa.core.processor - Predicted next action 'action_listen' with confidence 1.00.
2020-01-15 17:14:15 DEBUG rasa.core.processor - Action 'action_listen' ended with events '[]'.
2020-01-15 17:14:15 DEBUG rasa.core.lock_store - Deleted lock for conversation 'default'.
? Sorry, I'm not sure I've understood you correctly π€ Do you mean... 2: Something else (/out_of_scope)
2020-01-15 17:14:18 DEBUG rasa.core.tracker_store - Recreating tracker for id 'default'
2020-01-15 17:14:18 DEBUG rasa.core.processor - Received user message '/out_of_scope' with intent '{'name': 'out_of_scope', 'confidence': 1.0}' and entities '[]'
2020-01-15 17:14:18 DEBUG rasa.core.processor - Logged UserUtterance - tracker now has 15 events.
2020-01-15 17:14:18 DEBUG rasa.core.policies.memoization - Current tracker state [{'prev_action_default_ask_affirmation': 1.0, 'intent_affirm': 1.0}, {'intent_out_of_scope': 1.0, 'prev_action_listen': 1.0}, {'prev_action_default_ask_rephrase': 1.0, 'intent_out_of_scope': 1.0}, {'prev_action_listen': 1.0, 'intent_affirm': 1.0}, {'prev_action_default_ask_affirmation': 1.0, 'intent_affirm': 1.0}, {'intent_out_of_scope': 1.0, 'prev_action_listen': 1.0}]
2020-01-15 17:14:18 DEBUG rasa.core.policies.memoization - Launch DeLorean...
2020-01-15 17:14:18 DEBUG rasa.core.policies.memoization - Current tracker state [None, None, None, None, {}, {'intent_out_of_scope': 1.0, 'prev_action_listen': 1.0}]
2020-01-15 17:14:18 DEBUG rasa.core.policies.memoization - There is a memorised next action '163'
2020-01-15 17:14:18 DEBUG rasa.core.policies.two_stage_fallback - User 'default' denied suggested intents.
2020-01-15 17:14:18 DEBUG rasa.core.policies.form_policy - There is no active form
2020-01-15 17:14:18 DEBUG rasa.core.policies.ensemble - Predicted next action using policy_2_TwoStageFallbackPolicy
2020-01-15 17:14:18 DEBUG rasa.core.processor - Predicted next action 'action_default_fallback' with confidence 1.00.
2020-01-15 17:14:18 DEBUG rasa.core.actions.action - Calling action endpoint to run action 'action_default_fallback'.
2020-01-15 17:14:18 DEBUG rasa.core.processor - Action 'action_default_fallback' ended with events '[BotUttered('Click the button below if you want to start over.', {"elements": null, "quick_replies": null, "buttons": [{"payload": "/restart", "title": "Restart"}], "attachment": null, "image": null, "custom": null}, {}, 1579104858.9300601), <rasa.core.events.SlotSet object at 0x15e7f3c50>, <rasa.core.events.ConversationPaused object at 0x15e69d240>]'.
2020-01-15 17:14:18 DEBUG rasa.core.processor - Current slot values:
budget: None
business_email: None
can_use_spacy: None
company: None
current_api: None
email: None
entity_extractor: None
feedback_message: None
feedback_value: negative
job_function: None
language: None
name: None
nlu_part: None
onboarding: None
person_name: None
problem_description: None
product: None
requested_slot: None
shown_privacy: None
step: None
suggestion: None
unknown_nlu_part: None
unknown_product: None
use_case: None
2020-01-15 17:14:18 DEBUG rasa.core.lock_store - Deleted lock for conversation 'default'.
? Click the button below if you want to start over. 1: Restart (/restart)
2020-01-15 17:14:19 DEBUG rasa.core.tracker_store - Recreating tracker for id 'default'
2020-01-15 17:14:19 DEBUG rasa.core.processor - Received user message '/restart' with intent '{'name': 'restart', 'confidence': 1.0}' and entities '[]'
2020-01-15 17:14:19 DEBUG rasa.core.processor - Logged UserUtterance - tracker now has 20 events.
2020-01-15 17:14:19 WARNING rasa.core.featurizers - Feature 'intent_restart' could not be found in feature map.
2020-01-15 17:14:19 DEBUG rasa.core.policies.memoization - Current tracker state [{'intent_out_of_scope': 1.0, 'prev_action_listen': 1.0}, {'prev_action_default_ask_rephrase': 1.0, 'intent_out_of_scope': 1.0}, {'prev_action_listen': 1.0, 'intent_affirm': 1.0}, {'prev_action_default_ask_affirmation': 1.0, 'intent_affirm': 1.0}, {'intent_out_of_scope': 1.0, 'prev_action_listen': 1.0}, {'intent_restart': 1.0, 'slot_feedback_value_1': 1.0, 'prev_action_default_fallback': 1.0}]
2020-01-15 17:14:19 DEBUG rasa.core.policies.memoization - Launch DeLorean...
2020-01-15 17:14:19 DEBUG rasa.core.policies.memoization - Current tracker state [None, None, None, None, {}, {'intent_restart': 1.0, 'slot_feedback_value_1': 1.0, 'prev_action_default_fallback': 1.0}]
2020-01-15 17:14:19 DEBUG rasa.core.policies.memoization - There is no memorised next action
2020-01-15 17:14:19 DEBUG rasa.core.policies.form_policy - There is no active form
2020-01-15 17:14:19 DEBUG rasa.core.policies.mapping_policy - Restarting the conversation with action_restart.
2020-01-15 17:14:19 DEBUG rasa.core.policies.ensemble - Predicted next action using policy_2_TwoStageFallbackPolicy
2020-01-15 17:14:19 DEBUG rasa.core.processor - Predicted next action 'action_listen' with confidence 1.00.
2020-01-15 17:14:19 DEBUG rasa.core.processor - Action 'action_listen' ended with events '[]'.
2020-01-15 17:14:19 DEBUG rasa.core.lock_store - Deleted lock for conversation 'default'.
? Click the button below if you want to start over. 1: Restart (/restart)
2020-01-15 17:14:20 DEBUG rasa.core.tracker_store - Recreating tracker for id 'default'
2020-01-15 17:14:20 DEBUG rasa.core.processor - Received user message '/restart' with intent '{'name': 'restart', 'confidence': 1.0}' and entities '[]'
2020-01-15 17:14:20 DEBUG rasa.core.processor - Logged UserUtterance - tracker now has 22 events.
2020-01-15 17:14:20 WARNING rasa.core.featurizers - Feature 'intent_restart' could not be found in feature map.
2020-01-15 17:14:20 WARNING rasa.core.featurizers - Feature 'intent_restart' could not be found in feature map.
2020-01-15 17:14:20 DEBUG rasa.core.policies.memoization - Current tracker state [{'prev_action_default_ask_rephrase': 1.0, 'intent_out_of_scope': 1.0}, {'prev_action_listen': 1.0, 'intent_affirm': 1.0}, {'prev_action_default_ask_affirmation': 1.0, 'intent_affirm': 1.0}, {'intent_out_of_scope': 1.0, 'prev_action_listen': 1.0}, {'intent_restart': 1.0, 'slot_feedback_value_1': 1.0, 'prev_action_default_fallback': 1.0}, {'intent_restart': 1.0, 'slot_feedback_value_1': 1.0, 'prev_action_listen': 1.0}]
2020-01-15 17:14:20 DEBUG rasa.core.policies.memoization - Launch DeLorean...
2020-01-15 17:14:20 DEBUG rasa.core.policies.memoization - Current tracker state [None, None, None, None, {}, {'intent_restart': 1.0, 'prev_action_listen': 1.0}]
2020-01-15 17:14:20 DEBUG rasa.core.policies.memoization - There is no memorised next action
2020-01-15 17:14:20 DEBUG rasa.core.policies.two_stage_fallback - NLU confidence threshold met, confidence of fallback action set to core threshold (0.3).
2020-01-15 17:14:20 DEBUG rasa.core.policies.form_policy - There is no active form
2020-01-15 17:14:20 DEBUG rasa.core.policies.mapping_policy - The predicted intent 'restart' is mapped to action 'action_restart' in the domain.
2020-01-15 17:14:20 DEBUG rasa.core.policies.ensemble - Predicted next action using policy_4_MappingPolicy
2020-01-15 17:14:20 DEBUG rasa.core.processor - Predicted next action 'action_restart' with confidence 1.00.
2020-01-15 17:14:20 DEBUG rasa.core.processor - Action 'action_restart' ended with events '[BotUttered('Congrats you've restarted me! π', {"elements": null, "quick_replies": null, "buttons": null, "attachment": null, "image": null, "custom": null}, {}, 1579104860.883595), <rasa.core.events.Restarted object at 0x15e977f60>]'.
2020-01-15 17:14:20 DEBUG rasa.core.processor - Current slot values:
budget: None
business_email: None
can_use_spacy: None
company: None
current_api: None
email: None
entity_extractor: None
feedback_message: None
feedback_value: None
job_function: None
language: None
name: None
nlu_part: None
onboarding: None
person_name: None
problem_description: None
product: None
requested_slot: None
shown_privacy: None
step: None
suggestion: None
unknown_nlu_part: None
unknown_product: None
use_case: None
2020-01-15 17:14:20 DEBUG rasa.core.processor - Predicted next action 'action_listen' with confidence 1.00.
2020-01-15 17:14:20 DEBUG rasa.core.processor - Action 'action_listen' ended with events '[]'.
2020-01-15 17:14:20 DEBUG rasa.core.lock_store - Deleted lock for conversation 'default'.
Congrats you've restarted me! π
figured out how to replicate - when running in shell I get the /restart
option twice as mentioned, but on the docs it just presents the button once and I have to manually /restart
to get it to actually restart. will start working on it.
For a question for which it is falling under 2-stage fallback and showing buttons, but if without selecting from those options I am again posting a question then it is giving Restart option. The conversation is getting hanged after this Restart button even though if I am clicking on the Restart button.
Rasa Version : 1.3.7
Below is my Action file code :
class ActionDefaultFallback(Action): def name(self) -> Text: return "action_default_fallback"
class ActionDefaultAskAffirmation(Action): """Asks for an affirmation of the intent if NLU threshold is not met."""