search

Chatbot-Challenge / Frontend

GNU General Public License v3.0
0 stars 0 forks source link

[feat] add logging #1

Closed busch-matthias closed 1 year ago

busch-matthias commented 1 year ago
jnehring commented 1 year ago

Ich habe Rasa gestartet mit --log-file out.log --debug. Ohne --debug wird nix geloggt. Ich habe den Logfile gelöscht, einmal "go north" eingetippt und die Antwort "Bye" bekommen. Unter dem Ticket der Output aus dem Logfile für diese einzelne Interaktion.

Die wichtigen Infos (Session ID, User Utterance, Bot Antwort) sind drin. Das Parsing wird kompliziert. Wenn es eine einfachere Lösung gibt die Out of the box funktioniert dann sollten wir die benutzen.

2023-02-23 16:01:10,196 [DEBUG]  Issuing ticket for conversation '7911998a-7829-4f24-a408-75affb909407'.
2023-02-23 16:01:10,197 [DEBUG]  Acquiring lock for conversation '7911998a-7829-4f24-a408-75affb909407'.
2023-02-23 16:01:10,197 [DEBUG]  Acquired lock for conversation '7911998a-7829-4f24-a408-75affb909407'.
2023-02-23 16:01:10,197 [DEBUG]  Recreating tracker for id '7911998a-7829-4f24-a408-75affb909407'
2023-02-23 16:01:10,200 [DEBUG]  Running graph with inputs: {'__message__': [<rasa.core.channels.channel.UserMessage object at 0x282674f10>]}, targets: ['run_RegexMessageHandler'] and ExecutionContext(model_id='bb608fa290484f4b803bccb34cf9c6c5', should_add_diagnostic_data=False, is_finetuning=False, node_name=None).
2023-02-23 16:01:10,201 [DEBUG]  Node 'nlu_message_converter' running 'NLUMessageConverter.convert_user_message'.
2023-02-23 16:01:10,201 [DEBUG]  Node 'run_WhitespaceTokenizer0' running 'WhitespaceTokenizer.process'.
2023-02-23 16:01:10,201 [DEBUG]  Node 'run_RegexFeaturizer1' running 'RegexFeaturizer.process'.
2023-02-23 16:01:10,201 [DEBUG]  Node 'run_LexicalSyntacticFeaturizer2' running 'LexicalSyntacticFeaturizer.process'.
2023-02-23 16:01:10,202 [DEBUG]  Node 'run_CountVectorsFeaturizer3' running 'CountVectorsFeaturizer.process'.
2023-02-23 16:01:10,203 [DEBUG]  Node 'run_CountVectorsFeaturizer4' running 'CountVectorsFeaturizer.process'.
2023-02-23 16:01:10,204 [DEBUG]  Node 'run_DIETClassifier5' running 'DIETClassifier.process'.
2023-02-23 16:01:10,211 [DEBUG]  Node 'run_EntitySynonymMapper6' running 'EntitySynonymMapper.process'.
2023-02-23 16:01:10,212 [DEBUG]  Node 'run_ResponseSelector7' running 'ResponseSelector.process'.
2023-02-23 16:01:10,212 [DEBUG]  There is no trained model for 'ResponseSelector': The component is either not trained or didn't receive enough training data.
2023-02-23 16:01:10,212 [DEBUG]  Adding following selector key to message property: default
2023-02-23 16:01:10,212 [DEBUG]  Node 'run_FallbackClassifier8' running 'FallbackClassifier.process'.
2023-02-23 16:01:10,212 [DEBUG]  Node 'domain_provider' running 'DomainProvider.provide_inference'.
2023-02-23 16:01:10,212 [DEBUG]  Node 'run_RegexMessageHandler' running 'RegexMessageHandler.process'.
2023-02-23 16:01:10,212 [DEBUG]  Received user message 'look north' with intent '{'name': 'deny', 'confidence': 0.9843852519989014}' and entities '[]'
2023-02-23 16:01:10,213 [DEBUG]  Logged UserUtterance - tracker now has 30 events.
2023-02-23 16:01:10,213 [DEBUG]  Validating extracted slots: 
2023-02-23 16:01:10,213 [DEBUG]  Default action 'action_extract_slots' was executed, resulting in 0 events: 
2023-02-23 16:01:10,213 [DEBUG]  Running graph with inputs: {'__tracker__': <rasa.shared.core.trackers.DialogueStateTracker object at 0x294535d00>}, targets: ['select_prediction'] and ExecutionContext(model_id='bb608fa290484f4b803bccb34cf9c6c5', should_add_diagnostic_data=False, is_finetuning=False, node_name=None).
2023-02-23 16:01:10,214 [DEBUG]  Node 'rule_only_data_provider' running 'RuleOnlyDataProvider.provide'.
2023-02-23 16:01:10,214 [DEBUG]  Node 'domain_provider' running 'DomainProvider.provide_inference'.
2023-02-23 16:01:10,214 [DEBUG]  Node 'run_MemoizationPolicy0' running 'MemoizationPolicy.predict_action_probabilities'.
2023-02-23 16:01:10,215 [DEBUG]  Current tracker state:
[state 1] user intent: greet | previous action name: action_listen
[state 2] user intent: greet | previous action name: utter_greet
[state 3] user intent: mood_great | previous action name: action_listen
[state 4] user intent: mood_great | previous action name: utter_happy
[state 5] user intent: nlu_fallback | previous action name: action_listen
[state 6] user intent: nlu_fallback | previous action name: utter_happy
[state 7] user intent: affirm | previous action name: action_listen
[state 8] user intent: affirm | previous action name: utter_happy
[state 9] user intent: deny | previous action name: action_listen
2023-02-23 16:01:10,215 [DEBUG]  There is no memorised next action
2023-02-23 16:01:10,215 [DEBUG]  Node 'run_RulePolicy1' running 'RulePolicy.predict_action_probabilities'.
2023-02-23 16:01:10,215 [DEBUG]  Current tracker state:
[state 1] user intent: greet | previous action name: action_listen
[state 2] user intent: greet | previous action name: utter_greet
[state 3] user intent: mood_great | previous action name: action_listen
[state 4] user intent: mood_great | previous action name: utter_happy
[state 5] user intent: nlu_fallback | previous action name: action_listen
[state 6] user intent: nlu_fallback | previous action name: utter_happy
[state 7] user intent: affirm | previous action name: action_listen
[state 8] user intent: affirm | previous action name: action_unlikely_intent
[state 9] user intent: affirm | previous action name: utter_happy
[state 10] user text: look north | previous action name: action_listen
2023-02-23 16:01:10,216 [DEBUG]  There is no applicable rule.
2023-02-23 16:01:10,216 [DEBUG]  Current tracker state:
[state 1] user intent: greet | previous action name: action_listen
[state 2] user intent: greet | previous action name: utter_greet
[state 3] user intent: mood_great | previous action name: action_listen
[state 4] user intent: mood_great | previous action name: utter_happy
[state 5] user intent: nlu_fallback | previous action name: action_listen
[state 6] user intent: nlu_fallback | previous action name: utter_happy
[state 7] user intent: affirm | previous action name: action_listen
[state 8] user intent: affirm | previous action name: action_unlikely_intent
[state 9] user intent: affirm | previous action name: utter_happy
[state 10] user intent: deny | previous action name: action_listen
2023-02-23 16:01:10,216 [DEBUG]  There is no applicable rule.
2023-02-23 16:01:10,216 [DEBUG]  Node 'run_TEDPolicy3' running 'TEDPolicy.predict_action_probabilities'.
2023-02-23 16:01:10,221 [DEBUG]  TED predicted 'utter_goodbye' based on user intent.
2023-02-23 16:01:10,221 [DEBUG]  Node 'run_UnexpecTEDIntentPolicy2' running 'UnexpecTEDIntentPolicy.predict_action_probabilities'.
2023-02-23 16:01:10,225 [DEBUG]  Querying for intent `deny`.
2023-02-23 16:01:10,225 [DEBUG]  Score for intent `deny` is `-1.7045907974243164`, while threshold is `-1.4354991912841797`.
2023-02-23 16:01:10,225 [DEBUG]  Top 5 intents (in ascending order) that are likely here are: `[('bot_challenge', -1.8406624), ('deny', -1.7045908), ('nlu_fallback', -1.671125), ('out_of_scope', -1.4926084), ('greet', 1.7831904)]`.
2023-02-23 16:01:10,225 [DEBUG]  Intent `deny-3` unlikely to occur here.
2023-02-23 16:01:10,225 [DEBUG]  Node 'select_prediction' running 'DefaultPolicyPredictionEnsemble.combine_predictions_from_kwargs'.
2023-02-23 16:01:10,225 [DEBUG]  Made prediction using user intent.
2023-02-23 16:01:10,225 [DEBUG]  Added `DefinePrevUserUtteredFeaturization(False)` event.
2023-02-23 16:01:10,225 [DEBUG]  Predicted next action using UnexpecTEDIntentPolicy.
2023-02-23 16:01:10,225 [DEBUG]  Predicted next action 'action_unlikely_intent' with confidence 1.00.
2023-02-23 16:01:10,226 [DEBUG]  Policy prediction ended with events '[<rasa.shared.core.events.DefinePrevUserUtteredFeaturization object at 0x2945dadc0>]'.
2023-02-23 16:01:10,226 [DEBUG]  Action 'action_unlikely_intent' ended with events '[]'.
2023-02-23 16:01:10,226 [DEBUG]  Current slot values: 
    session_started_metadata: None
2023-02-23 16:01:10,226 [DEBUG]  Running graph with inputs: {'__tracker__': <rasa.shared.core.trackers.DialogueStateTracker object at 0x294535d00>}, targets: ['select_prediction'] and ExecutionContext(model_id='bb608fa290484f4b803bccb34cf9c6c5', should_add_diagnostic_data=False, is_finetuning=False, node_name=None).
2023-02-23 16:01:10,226 [DEBUG]  Node 'rule_only_data_provider' running 'RuleOnlyDataProvider.provide'.
2023-02-23 16:01:10,226 [DEBUG]  Node 'domain_provider' running 'DomainProvider.provide_inference'.
2023-02-23 16:01:10,226 [DEBUG]  Node 'run_MemoizationPolicy0' running 'MemoizationPolicy.predict_action_probabilities'.
2023-02-23 16:01:10,227 [DEBUG]  Current tracker state:
[state 1] user intent: greet | previous action name: action_listen
[state 2] user intent: greet | previous action name: utter_greet
[state 3] user intent: mood_great | previous action name: action_listen
[state 4] user intent: mood_great | previous action name: utter_happy
[state 5] user intent: nlu_fallback | previous action name: action_listen
[state 6] user intent: nlu_fallback | previous action name: utter_happy
[state 7] user intent: affirm | previous action name: action_listen
[state 8] user intent: affirm | previous action name: utter_happy
[state 9] user intent: deny | previous action name: action_listen
2023-02-23 16:01:10,227 [DEBUG]  There is no memorised next action
2023-02-23 16:01:10,227 [DEBUG]  Node 'run_RulePolicy1' running 'RulePolicy.predict_action_probabilities'.
2023-02-23 16:01:10,227 [DEBUG]  Current tracker state:
[state 1] user intent: greet | previous action name: action_listen
[state 2] user intent: greet | previous action name: utter_greet
[state 3] user intent: mood_great | previous action name: action_listen
[state 4] user intent: mood_great | previous action name: utter_happy
[state 5] user intent: nlu_fallback | previous action name: action_listen
[state 6] user intent: nlu_fallback | previous action name: utter_happy
[state 7] user intent: affirm | previous action name: action_listen
[state 8] user intent: affirm | previous action name: action_unlikely_intent
[state 9] user intent: affirm | previous action name: utter_happy
[state 10] user intent: deny | previous action name: action_listen
[state 11] user intent: deny | previous action name: action_unlikely_intent
2023-02-23 16:01:10,228 [DEBUG]  There is no applicable rule.
2023-02-23 16:01:10,228 [DEBUG]  Node 'run_TEDPolicy3' running 'TEDPolicy.predict_action_probabilities'.
2023-02-23 16:01:10,231 [DEBUG]  TED predicted 'utter_goodbye' based on user intent.
2023-02-23 16:01:10,231 [DEBUG]  Node 'run_UnexpecTEDIntentPolicy2' running 'UnexpecTEDIntentPolicy.predict_action_probabilities'.
2023-02-23 16:01:10,231 [DEBUG]  Skipping predictions for UnexpecTEDIntentPolicy as either there is no event of type `UserUttered`, event's intent is new and not in domain or there is an event of type `ActionExecuted` after the last `UserUttered`.
2023-02-23 16:01:10,231 [DEBUG]  Node 'select_prediction' running 'DefaultPolicyPredictionEnsemble.combine_predictions_from_kwargs'.
2023-02-23 16:01:10,231 [DEBUG]  Predicted next action using TEDPolicy.
2023-02-23 16:01:10,231 [DEBUG]  Predicted next action 'utter_goodbye' with confidence 0.33.
2023-02-23 16:01:10,231 [DEBUG]  Policy prediction ended with events '[]'.
2023-02-23 16:01:10,232 [DEBUG]  Action 'utter_goodbye' ended with events '[BotUttered('Bye', {"elements": null, "quick_replies": null, "buttons": null, "attachment": null, "image": null, "custom": null}, {"utter_action": "utter_goodbye"}, 1677196870.231989)]'.
2023-02-23 16:01:10,232 [DEBUG]  Running graph with inputs: {'__tracker__': <rasa.shared.core.trackers.DialogueStateTracker object at 0x294535d00>}, targets: ['select_prediction'] and ExecutionContext(model_id='bb608fa290484f4b803bccb34cf9c6c5', should_add_diagnostic_data=False, is_finetuning=False, node_name=None).
2023-02-23 16:01:10,232 [DEBUG]  Node 'rule_only_data_provider' running 'RuleOnlyDataProvider.provide'.
2023-02-23 16:01:10,232 [DEBUG]  Node 'domain_provider' running 'DomainProvider.provide_inference'.
2023-02-23 16:01:10,232 [DEBUG]  Node 'run_MemoizationPolicy0' running 'MemoizationPolicy.predict_action_probabilities'.
2023-02-23 16:01:10,232 [DEBUG]  Current tracker state:
[state 1] user intent: greet | previous action name: action_listen
[state 2] user intent: greet | previous action name: utter_greet
[state 3] user intent: mood_great | previous action name: action_listen
[state 4] user intent: mood_great | previous action name: utter_happy
[state 5] user intent: nlu_fallback | previous action name: action_listen
[state 6] user intent: nlu_fallback | previous action name: utter_happy
[state 7] user intent: affirm | previous action name: action_listen
[state 8] user intent: affirm | previous action name: utter_happy
[state 9] user intent: deny | previous action name: action_listen
[state 10] user intent: deny | previous action name: utter_goodbye
2023-02-23 16:01:10,233 [DEBUG]  There is no memorised next action
2023-02-23 16:01:10,233 [DEBUG]  Node 'run_RulePolicy1' running 'RulePolicy.predict_action_probabilities'.
2023-02-23 16:01:10,233 [DEBUG]  Current tracker state:
[state 1] user intent: greet | previous action name: action_listen
[state 2] user intent: greet | previous action name: utter_greet
[state 3] user intent: mood_great | previous action name: action_listen
[state 4] user intent: mood_great | previous action name: utter_happy
[state 5] user intent: nlu_fallback | previous action name: action_listen
[state 6] user intent: nlu_fallback | previous action name: utter_happy
[state 7] user intent: affirm | previous action name: action_listen
[state 8] user intent: affirm | previous action name: action_unlikely_intent
[state 9] user intent: affirm | previous action name: utter_happy
[state 10] user intent: deny | previous action name: action_listen
[state 11] user intent: deny | previous action name: action_unlikely_intent
[state 12] user intent: deny | previous action name: utter_goodbye
2023-02-23 16:01:10,233 [DEBUG]  There is no applicable rule.
2023-02-23 16:01:10,233 [DEBUG]  Node 'run_TEDPolicy3' running 'TEDPolicy.predict_action_probabilities'.
2023-02-23 16:01:10,236 [DEBUG]  TED predicted 'action_listen' based on user intent.
2023-02-23 16:01:10,236 [DEBUG]  Node 'run_UnexpecTEDIntentPolicy2' running 'UnexpecTEDIntentPolicy.predict_action_probabilities'.
2023-02-23 16:01:10,236 [DEBUG]  Skipping predictions for UnexpecTEDIntentPolicy as either there is no event of type `UserUttered`, event's intent is new and not in domain or there is an event of type `ActionExecuted` after the last `UserUttered`.
2023-02-23 16:01:10,236 [DEBUG]  Node 'select_prediction' running 'DefaultPolicyPredictionEnsemble.combine_predictions_from_kwargs'.
2023-02-23 16:01:10,236 [DEBUG]  Predicted next action using TEDPolicy.
2023-02-23 16:01:10,237 [DEBUG]  Predicted next action 'action_listen' with confidence 0.99.
2023-02-23 16:01:10,237 [DEBUG]  Policy prediction ended with events '[]'.
2023-02-23 16:01:10,237 [DEBUG]  Action 'action_listen' ended with events '[]'.
2023-02-23 16:01:10,237 [DEBUG]  Deleted lock for conversation '7911998a-7829-4f24-a408-75affb909407'.
busch-matthias commented 1 year ago

Pro Team ordner mit : Teilnehmer ID, Verlauf in CSV

jnehring commented 1 year ago

Philine hat das schon implementiert und hat angeboten das Ticket zu übernehmen.

jnehring commented 1 year ago

Das wurde mit #23 erledigt. Es werden keine Sessions beim Loggen abgespeichert.