Retrieve incident status

[indam23]

• Implement retrieving the status of an incident by email address
• some refactoring
• Snow code moved to own class
• Closes https://github.com/RasaHQ/helpdesk-assistant/issues/7

[github-actions[bot]]

Intent Cross-Validation Results (5 folds)

class	support	f1-score	confused_with
macro avg	125	0.8688	N/A
weighted avg	125	0.8636	N/A
open_incident	15	0.8000	problem_email(1)
inform	13	0.8333	open_incident(2), deny(1)
incident_status	13	0.8333	open_incident(3)
affirm	12	0.7619	deny(2), greet(1)
out_of_scope	12	0.9565	incident_status(1)
problem_email	10	0.9524	N/A
password_reset	9	1.0000	N/A
greet	8	0.8889	N/A
deny	8	0.7778	inform(1)
help	7	0.8571	affirm(1)
goodbye	6	0.8333	greet(1)
bot_challenge	6	1.0000	N/A
thank	6	0.8000	open_incident(1), help(1)

Entity Cross-Validation Results (5 folds)

entity	support	f1-score	precision	recall
priority	13	0.8182	1	0.6923
micro avg	13	0.8182	1	0.6923
macro avg	13	0.8182	1	0.6923
weighted avg	13	0.8182	1	0.6923

[github-actions[bot]]

Intent Cross-Validation Results (5 folds)

class	support	f1-score	confused_with
macro avg	125	0.7852	N/A
weighted avg	125	0.7852	N/A
open_incident	15	0.8000	problem_email(1)
incident_status	13	0.8800	open_incident(1), inform(1)
inform	13	0.5455	open_incident(2), goodbye(2)
out_of_scope	12	0.9565	open_incident(1)
affirm	12	0.6000	goodbye(2), thank(1)
problem_email	10	0.8000	open_incident(2)
password_reset	9	1.0000	N/A
deny	8	0.8000	thank(1), inform(1)
greet	8	0.8235	help(1)
help	7	0.9333	N/A
thank	6	0.5455	inform(1), bot_challenge(1)
bot_challenge	6	0.8571	N/A
goodbye	6	0.6667	greet(1)

Entity Cross-Validation Results (5 folds)

entity	support	f1-score	precision	recall
priority	13	0.7000	1	0.5385
micro avg	13	0.7000	1	0.5385
macro avg	13	0.7000	1	0.5385
weighted avg	13	0.7000	1	0.5385

[github-actions[bot]]

Intent Cross-Validation Results (5 folds)

class	support	f1-score	confused_with
macro avg	125	0.8468	N/A
weighted avg	125	0.8427	N/A
open_incident	15	0.8667	problem_email(1), incident_status(1)
incident_status	13	0.8800	problem_email(1), open_incident(1)
inform	13	0.6667	goodbye(2), problem_email(1)
out_of_scope	12	1.0000	N/A
affirm	12	0.7000	deny(2), thank(1)
problem_email	10	0.8333	N/A
password_reset	9	0.9474	N/A
greet	8	0.9412	N/A
deny	8	0.7059	thank(1), inform(1)
help	7	1.0000	N/A
goodbye	6	0.8000	N/A
bot_challenge	6	1.0000	N/A
thank	6	0.6667	problem_email(1), goodbye(1)

Entity Cross-Validation Results (5 folds)

entity	support	f1-score	precision	recall
priority	13	0.5556	1	0.3846
micro avg	13	0.5556	1	0.3846
macro avg	13	0.5556	1	0.3846
weighted avg	13	0.5556	1	0.3846

[b-quachtran]

When responding with '/deny' to the 'Should I open an incident?' prompt, the form doesn't deactivate until I respond with '/deny' twice.

[indam23]

Thanks for catching that @b-quachtran! there was a missing utterance template. It should be fixed now.

[github-actions[bot]]

Intent Cross-Validation Results (5 folds)

class	support	f1-score	confused_with
macro avg	125	0.8434	N/A
weighted avg	125	0.8363	N/A
open_incident	15	0.8235	problem_email(1)
incident_status	13	0.8333	open_incident(3)
inform	13	0.7826	problem_email(1), open_incident(1)
affirm	12	0.7000	deny(2), thank(1)
out_of_scope	12	0.8696	password_reset(1), incident_status(1)
problem_email	10	0.9091	N/A
password_reset	9	0.9474	N/A
deny	8	0.7500	thank(1), inform(1)
greet	8	0.8889	N/A
help	7	0.8571	open_incident(1)
goodbye	6	0.8333	greet(1)
bot_challenge	6	1.0000	N/A
thank	6	0.7692	out_of_scope(1)

Entity Cross-Validation Results (5 folds)

entity	support	f1-score	precision	recall
priority	13	0.7000	1	0.5385
micro avg	13	0.7000	1	0.5385
macro avg	13	0.7000	1	0.5385
weighted avg	13	0.7000	1	0.5385

[github-actions[bot]]

Intent Cross-Validation Results (5 folds)

class	support	f1-score	confused_with
macro avg	125	0.8523	N/A
weighted avg	125	0.8447	N/A
open_incident	15	0.8235	problem_email(1)
incident_status	13	0.8333	open_incident(3)
inform	13	0.6957	open_incident(2), goodbye(2)
affirm	12	0.6667	goodbye(2), deny(2)
out_of_scope	12	0.9565	incident_status(1)
problem_email	10	0.9524	N/A
password_reset	9	1.0000	N/A
deny	8	0.7778	inform(1)
greet	8	0.9412	N/A
help	7	1.0000	N/A
thank	6	0.7273	inform(1), goodbye(1)
goodbye	6	0.7059	N/A
bot_challenge	6	1.0000	N/A

Entity Cross-Validation Results (5 folds)

entity	support	f1-score	precision	recall
priority	13	0.7000	1	0.5385
micro avg	13	0.7000	1	0.5385
macro avg	13	0.7000	1	0.5385
weighted avg	13	0.7000	1	0.5385

[github-actions[bot]]

Intent Cross-Validation Results (5 folds)

class	support	f1-score	confused_with
macro avg	125	0.8786	N/A
weighted avg	125	0.8776	N/A
open_incident	15	0.8485	problem_email(1)
incident_status	13	0.8462	open_incident(2)
inform	13	0.8696	open_incident(2), incident_status(1)
affirm	12	0.7619	goodbye(2), deny(2)
out_of_scope	12	0.9600	N/A
problem_email	10	0.9524	N/A
password_reset	9	1.0000	N/A
deny	8	0.7500	incident_status(1), affirm(1)
greet	8	0.9412	N/A
help	7	1.0000	N/A
bot_challenge	6	0.9231	N/A
goodbye	6	0.7692	greet(1)
thank	6	0.8000	out_of_scope(1), bot_challenge(1)

Entity Cross-Validation Results (5 folds)

entity	support	f1-score	precision	recall
priority	13	0.8182	1	0.6923
micro avg	13	0.8182	1	0.6923
macro avg	13	0.8182	1	0.6923
weighted avg	13	0.8182	1	0.6923

[github-actions[bot]]

Intent Cross-Validation Results (5 folds)

class	support	f1-score	confused_with
macro avg	125	0.8477	N/A
weighted avg	125	0.8459	N/A
open_incident	15	0.8235	problem_email(1)
inform	13	0.7826	open_incident(2), incident_status(2)
incident_status	13	0.7407	open_incident(3)
affirm	12	0.8000	deny(2), greet(1)
out_of_scope	12	0.9565	incident_status(1)
problem_email	10	0.9524	N/A
password_reset	9	1.0000	N/A
deny	8	0.7059	thank(1), incident_status(1)
greet	8	0.8889	N/A
help	7	1.0000	N/A
bot_challenge	6	1.0000	N/A
goodbye	6	0.7692	greet(1)
thank	6	0.6000	inform(1), goodbye(1)

Entity Cross-Validation Results (5 folds)

entity	support	f1-score	precision	recall
priority	13	0.8182	1	0.6923
micro avg	13	0.8182	1	0.6923
macro avg	13	0.8182	1	0.6923
weighted avg	13	0.8182	1	0.6923