nyu-mll / jiant-v1-legacy

The jiant toolkit for general-purpose text understanding models
MIT License
21 stars 9 forks source link

[CLOSED] Mnli diagnostic results fix #229

Closed jeswan closed 4 years ago

jeswan commented 4 years ago

Issue by Jan21 Monday Jul 23, 2018 at 21:03 GMT Originally opened as https://github.com/nyu-mll/jiant/pull/229


Renames the score for the category in mnli-diagnostic from 'missing' to the name of the category.


Jan21 included the following code: https://github.com/nyu-mll/jiant/pull/229/commits

jeswan commented 4 years ago

Comment by Jan21 Monday Jul 23, 2018 at 21:17 GMT


micro_avg: 0.000, macro_avg: 0.000, mnli-diagnostic_accuracy: 0.000, mnli-diagnostic_lex_semMorphological negation: 0.000, mnli-diagnostic_lex_semLexical entailment: 0.000, mnli-diagnostic_lex_semQuantifiers: 0.000, mnli-diagnostic_lex_semRedundancy: 0.000, mnli-diagnostic_lex_semSymmetry/Collectivity: 0.000, mnli-diagnostic_lex_semNamed entities: 0.000, mnli-diagnostic_lex_semFactivity: 0.000, mnli-diagnostic_lex_sem: 0.000, mnli-diagnostic_pr_ar_str__Anaphora/Coreference: 0.000, mnli-diagnostic_pr_ar_strIntersectivity: 0.000, mnli-diagnostic_pr_ar_strNominalization: 0.000, mnli-diagnostic_pr_ar_str__Active/Passive: 0.000, mnli-diagnostic_pr_ar_strPrepositional phrases: 0.000, mnli-diagnostic_pr_ar_strGenitives/Partitives: 0.000, mnli-diagnostic_pr_ar_str__Core args: 0.000, mnli-diagnostic_pr_ar_strRelative clauses: 0.000, mnli-diagnostic_pr_ar_strCoordination scope: 0.000, mnli-diagnostic_pr_ar_str__Restrictivity: 0.000, mnli-diagnostic_pr_ar_strDatives: 0.000, mnli-diagnostic_pr_ar_strEllipsis/Implicits: 0.000, mnli-diagnostic_pr_ar_str: 0.000, mnli-diagnostic_logicNegation: 0.000, mnli-diagnostic_logicConditionals: 0.000, mnli-diagnostic_logic__Double negation: 0.000, mnli-diagnostic_logicUpward monotone: 0.000, mnli-diagnostic_logicDownward monotone: 0.000, mnli-diagnostic_logic__Intervals/Numbers: 0.000, mnli-diagnostic_logicConjunction: 0.000, mnli-diagnostic_logicDisjunction: 0.000, mnli-diagnostic_logic__Universal: 0.000, mnli-diagnostic_logicExistential: 0.000, mnli-diagnostic_logicTemporal: 0.000, mnli-diagnostic_logicNon-monotone: 0.000, mnli-diagnostic_logic: 0.000, mnli-diagnostic_knowledgeWorld knowledge: 0.000, mnli-diagnostic_knowledgeCommon sense: 0.000, mnli-diagnostic_knowledge: 0.000