RasaHQ / carbon-bot

Apache License 2.0
42 stars 31 forks source link

Entity report #25

Closed amn41 closed 4 years ago

github-actions[bot] commented 4 years ago

Intent Cross-Validation Results (5 folds)

class support f1-score confused_with
macro avg 2541 0.7999 N/A
weighted avg 2541 0.8392 N/A
faq 753 0.8172 inform(29), inquire-ask_clarification-offsets(17)
inform 619 0.9367 faq(24), estimate_emissions(6)
affirm 255 0.9002 inform(7), faq(6)
inquire-ask_clarification-offsets 124 0.7581 faq(22), why(2)
estimate_emissions 73 0.6405 faq(13), inquire-ask_clarification-offsets(6)
deny 69 0.8527 faq(7), farewell(1)
greet 63 0.8926 faq(7), express_positive-emo(2)
why 59 0.7748 faq(12), inquire-ask_clarification-offsets(2)
inform_notunderstanding 58 0.6154 faq(17), affirm(3)
farewell 57 0.7890 faq(10), affirm(2)
thank 54 0.9159 faq(2), farewell(1)
express_positive-emo 48 0.7551 faq(5), affirm(3)
express_uncertainty 43 0.7838 faq(9), affirm(1)
express_surprise 43 0.7561 faq(9), estimate_emissions(2)
inquire-ask_clarification 38 0.5333 faq(17), why(2)
buy_offsets 35 0.7879 faq(6), affirm(1)
how_calculated 29 0.8679 faq(4), inquire-ask_clarification-offsets(1)
deny_flying 28 0.7660 faq(7), inform(2)
express_negative-emo 25 0.6818 faq(4), inform_notunderstanding(3)
resolve_entity 20 1.0000 N/A
restart 18 1.0000 N/A
meta_inform_problem_bad-link 12 0.9231 N/A
SCENARIO 10 0.6250 thank(2), inform(1)
help 8 0.8235 faq(1)

Entity Cross-Validation Results (5 folds)

entity support f1-score precision recall
micro avg 1251 0.7778 0.9212 0.6731
macro avg 1251 0.6852 0.9167 0.5699
weighted avg 1251 0.7751 0.9224 0.6731
city 939 0.7968 0.9329 0.6954
iata 192 0.6818 0.9052 0.5469
travel_flight_class 87 0.8304 0.8452 0.8161
mention 23 0.5455 0.9000 0.3913
number 10 0.5714 1.0000 0.4000