search

nyu-mll / jiant-v1-legacy

The jiant toolkit for general-purpose text understanding models
MIT License
21 stars 9 forks source link

[CLOSED] Tons of label namespace warnings for diagnostic. #833

Closed jeswan closed 4 years ago

jeswan commented 4 years ago

Issue by sleepinyourhat Wednesday Jul 10, 2019 at 02:38 GMT Originally opened as https://github.com/nyu-mll/jiant/issues/833

We get this gigantic log message when indexing the linguistic diagnostic set:

07/09 10:37:15 PM:  Task broadcoverage-diagnostic (train): Indexing from scratch.
07/09 10:37:15 PM: Your label namespace was 'idx'. We recommend you use a namespace ending with 'labels' or 'tags', so we don't add UNK and PAD tokens by default to your vocabulary.  See documentation for `non_padded_namespaces` parameter in Vocabulary.
07/09 10:37:15 PM: Your label namespace was 'lex_sem'. We recommend you use a namespace ending with 'labels' or 'tags', so we don't add UNK and PAD tokens by default to your vocabulary.  See documentation for `non_padded_namespaces` parameter in Vocabulary.
07/09 10:37:15 PM: Your label namespace was 'lex_sem__Quantifiers'. We recommend you use a namespace ending with 'labels' or 'tags', so we don't add UNK and PAD tokens by default to your vocabulary.  See documentation for `non_padded_namespaces` parameter in Vocabulary.
07/09 10:37:15 PM: Your label namespace was 'lex_sem__Lexical entailment;Quantifiers'. We recommend you use a namespace ending with 'labels' or 'tags', so we don't add UNK and PAD tokens by default to your vocabulary.  See documentation for `non_padded_namespaces` parameter in Vocabulary.
07/09 10:37:15 PM: Your label namespace was 'lex_sem__Factivity'. We recommend you use a namespace ending with 'labels' or 'tags', so we don't add UNK and PAD tokens by default to your vocabulary.  See documentation for `non_padded_namespaces` parameter in Vocabulary.
07/09 10:37:15 PM: Your label namespace was 'lex_sem__Factivity;Quantifiers'. We recommend you use a namespace ending with 'labels' or 'tags', so we don't add UNK and PAD tokens by default to your vocabulary.  See documentation for `non_padded_namespaces` parameter in Vocabulary.
07/09 10:37:15 PM: Your label namespace was 'lex_sem__Morphological negation'. We recommend you use a namespace ending with 'labels' or 'tags', so we don't add UNK and PAD tokens by default to your vocabulary.  See documentation for `non_padded_namespaces` parameter in Vocabulary.
07/09 10:37:15 PM: Your label namespace was 'lex_sem__Redundancy'. We recommend you use a namespace ending with 'labels' or 'tags', so we don't add UNK and PAD tokens by default to your vocabulary.  See documentation for `non_padded_namespaces` parameter in Vocabulary.
07/09 10:37:15 PM: Your label namespace was 'lex_sem__Lexical entailment;Factivity'. We recommend you use a namespace ending with 'labels' or 'tags', so we don't add UNK and PAD tokens by default to your vocabulary.  See documentation for `non_padded_namespaces` parameter in Vocabulary.
07/09 10:37:15 PM: Your label namespace was 'lex_sem__Lexical entailment'. We recommend you use a namespace ending with 'labels' or 'tags', so we don't add UNK and PAD tokens by default to your vocabulary.  See documentation for `non_padded_namespaces` parameter in Vocabulary.
07/09 10:37:15 PM: Your label namespace was 'lex_sem__Symmetry/Collectivity'. We recommend you use a namespace ending with 'labels' or 'tags', so we don't add UNK and PAD tokens by default to your vocabulary.  See documentation for `non_padded_namespaces` parameter in Vocabulary.
07/09 10:37:15 PM: Your label namespace was 'pr_ar_str'. We recommend you use a namespace ending with 'labels' or 'tags', so we don't add UNK and PAD tokens by default to your vocabulary.  See documentation for `non_padded_namespaces` parameter in Vocabulary.
07/09 10:37:15 PM: Your label namespace was 'pr_ar_str__Anaphora/Coreference;Prepositional phrases'. We recommend you use a namespace ending with 'labels' or 'tags', so we don't add UNK and PAD tokens by default to your vocabulary.  See documentation for `non_padded_namespaces` parameter in Vocabulary.
07/09 10:37:15 PM: Your label namespace was 'pr_ar_str__Ellipsis/Implicits;Anaphora/Coreference'. We recommend you use a namespace ending with 'labels' or 'tags', so we don't add UNK and PAD tokens by default to your vocabulary.  See documentation for `non_padded_namespaces` parameter in Vocabulary.
07/09 10:37:15 PM: Your label namespace was 'pr_ar_str__Restrictivity;Relative clauses'. We recommend you use a namespace ending with 'labels' or 'tags', so we don't add UNK and PAD tokens by default to your vocabulary.  See documentation for `non_padded_namespaces` parameter in Vocabulary.
07/09 10:37:15 PM: Your label namespace was 'pr_ar_str__Active/Passive'. We recommend you use a namespace ending with 'labels' or 'tags', so we don't add UNK and PAD tokens by default to your vocabulary.  See documentation for `non_padded_namespaces` parameter in Vocabulary.
07/09 10:37:15 PM: Your label namespace was 'pr_ar_str__Coordination scope;Prepositional phrases'. We recommend you use a namespace ending with 'labels' or 'tags', so we don't add UNK and PAD tokens by default to your vocabulary.  See documentation for `non_padded_namespaces` parameter in Vocabulary.
07/09 10:37:15 PM: Your label namespace was 'pr_ar_str__Active/Passive;Prepositional phrases'. We recommend you use a namespace ending with 'labels' or 'tags', so we don't add UNK and PAD tokens by default to your vocabulary.  See documentation for `non_padded_namespaces` parameter in Vocabulary.
07/09 10:37:15 PM: Your label namespace was 'pr_ar_str__Relative clauses'. We recommend you use a namespace ending with 'labels' or 'tags', so we don't add UNK and PAD tokens by default to your vocabulary.  See documentation for `non_padded_namespaces` parameter in Vocabulary.
07/09 10:37:15 PM: Your label namespace was 'pr_ar_str__Datives'. We recommend you use a namespace ending with 'labels' or 'tags', so we don't add UNK and PAD tokens by default to your vocabulary.  See documentation for `non_padded_namespaces` parameter in Vocabulary.
07/09 10:37:15 PM: Your label namespace was 'pr_ar_str__Prepositional phrases'. We recommend you use a namespace ending with 'labels' or 'tags', so we don't add UNK and PAD tokens by default to your vocabulary.  See documentation for `non_padded_namespaces` parameter in Vocabulary.
07/09 10:37:15 PM: Your label namespace was 'pr_ar_str__Relative clauses;Anaphora/Coreference'. We recommend you use a namespace ending with 'labels' or 'tags', so we don't add UNK and PAD tokens by default to your vocabulary.  See documentation for `non_padded_namespaces` parameter in Vocabulary.
07/09 10:37:15 PM: Your label namespace was 'pr_ar_str__Genitives/Partitives'. We recommend you use a namespace ending with 'labels' or 'tags', so we don't add UNK and PAD tokens by default to your vocabulary.  See documentation for `non_padded_namespaces` parameter in Vocabulary.
07/09 10:37:15 PM: Your label namespace was 'pr_ar_str__Nominalization'. We recommend you use a namespace ending with 'labels' or 'tags', so we don't add UNK and PAD tokens by default to your vocabulary.  See documentation for `non_padded_namespaces` parameter in Vocabulary.
07/09 10:37:15 PM: Your label namespace was 'pr_ar_str__Relative clauses;Restrictivity'. We recommend you use a namespace ending with 'labels' or 'tags', so we don't add UNK and PAD tokens by default to your vocabulary.  See documentation for `non_padded_namespaces` parameter in Vocabulary.
07/09 10:37:15 PM: Your label namespace was 'pr_ar_str__Anaphora/Coreference'. We recommend you use a namespace ending with 'labels' or 'tags', so we don't add UNK and PAD tokens by default to your vocabulary.  See documentation for `non_padded_namespaces` parameter in Vocabulary.
07/09 10:37:15 PM: Your label namespace was 'pr_ar_str__Restrictivity;Anaphora/Coreference'. We recommend you use a namespace ending with 'labels' or 'tags', so we don't add UNK and PAD tokens by default to your vocabulary.  See documentation for `non_padded_namespaces` parameter in Vocabulary.
07/09 10:37:15 PM: Your label namespace was 'pr_ar_str__Core args'. We recommend you use a namespace ending with 'labels' or 'tags', so we don't add UNK and PAD tokens by default to your vocabulary.  See documentation for `non_padded_namespaces` parameter in Vocabulary.
07/09 10:37:15 PM: Your label namespace was 'pr_ar_str__Core args;Anaphora/Coreference'. We recommend you use a namespace ending with 'labels' or 'tags', so we don't add UNK and PAD tokens by default to your vocabulary.  See documentation for `non_padded_namespaces` parameter in Vocabulary.
07/09 10:37:15 PM: Your label namespace was 'pr_ar_str__Restrictivity'. We recommend you use a namespace ending with 'labels' or 'tags', so we don't add UNK and PAD tokens by default to your vocabulary.  See documentation for `non_padded_namespaces` parameter in Vocabulary.
07/09 10:37:15 PM: Your label namespace was 'pr_ar_str__Ellipsis/Implicits'. We recommend you use a namespace ending with 'labels' or 'tags', so we don't add UNK and PAD tokens by default to your vocabulary.  See documentation for `non_padded_namespaces` parameter in Vocabulary.
07/09 10:37:15 PM: Your label namespace was 'pr_ar_str__Intersectivity;Ellipsis/Implicits'. We recommend you use a namespace ending with 'labels' or 'tags', so we don't add UNK and PAD tokens by default to your vocabulary.  See documentation for `non_padded_namespaces` parameter in Vocabulary.
07/09 10:37:15 PM: Your label namespace was 'pr_ar_str__Nominalization;Genitives/Partitives'. We recommend you use a namespace ending with 'labels' or 'tags', so we don't add UNK and PAD tokens by default to your vocabulary.  See documentation for `non_padded_namespaces` parameter in Vocabulary.
07/09 10:37:15 PM: Your label namespace was 'pr_ar_str__Coordination scope'. We recommend you use a namespace ending with 'labels' or 'tags', so we don't add UNK and PAD tokens by default to your vocabulary.  See documentation for `non_padded_namespaces` parameter in Vocabulary.
07/09 10:37:15 PM: Your label namespace was 'logic'. We recommend you use a namespace ending with 'labels' or 'tags', so we don't add UNK and PAD tokens by default to your vocabulary.  See documentation for `non_padded_namespaces` parameter in Vocabulary.
07/09 10:37:15 PM: Your label namespace was 'logic__Downward monotone;Conditionals'. We recommend you use a namespace ending with 'labels' or 'tags', so we don't add UNK and PAD tokens by default to your vocabulary.  See documentation for `non_padded_namespaces` parameter in Vocabulary.
07/09 10:37:15 PM: Your label namespace was 'logic__Upward monotone'. We recommend you use a namespace ending with 'labels' or 'tags', so we don't add UNK and PAD tokens by default to your vocabulary.  See documentation for `non_padded_namespaces` parameter in Vocabulary.
07/09 10:37:15 PM: Your label namespace was 'logic__Negation'. We recommend you use a namespace ending with 'labels' or 'tags', so we don't add UNK and PAD tokens by default to your vocabulary.  See documentation for `non_padded_namespaces` parameter in Vocabulary.
07/09 10:37:15 PM: Your label namespace was 'logic__Existential;Upward monotone'. We recommend you use a namespace ending with 'labels' or 'tags', so we don't add UNK and PAD tokens by default to your vocabulary.  See documentation for `non_padded_namespaces` parameter in Vocabulary.
07/09 10:37:15 PM: Your label namespace was 'logic__Disjunction;Negation'. We recommend you use a namespace ending with 'labels' or 'tags', so we don't add UNK and PAD tokens by default to your vocabulary.  See documentation for `non_padded_namespaces` parameter in Vocabulary.
07/09 10:37:15 PM: Your label namespace was 'logic__Existential'. We recommend you use a namespace ending with 'labels' or 'tags', so we don't add UNK and PAD tokens by default to your vocabulary.  See documentation for `non_padded_namespaces` parameter in Vocabulary.
07/09 10:37:15 PM: Your label namespace was 'logic__Intervals/Numbers;Non-monotone'. We recommend you use a namespace ending with 'labels' or 'tags', so we don't add UNK and PAD tokens by default to your vocabulary.  See documentation for `non_padded_namespaces` parameter in Vocabulary.
07/09 10:37:15 PM: Your label namespace was 'logic__Temporal;Intervals/Numbers'. We recommend you use a namespace ending with 'labels' or 'tags', so we don't add UNK and PAD tokens by default to your vocabulary.  See documentation for `non_padded_namespaces` parameter in Vocabulary.
07/09 10:37:15 PM: Your label namespace was 'logic__Universal'. We recommend you use a namespace ending with 'labels' or 'tags', so we don't add UNK and PAD tokens by default to your vocabulary.  See documentation for `non_padded_namespaces` parameter in Vocabulary.
07/09 10:37:15 PM: Your label namespace was 'logic__Downward monotone;Existential;Negation'. We recommend you use a namespace ending with 'labels' or 'tags', so we don't add UNK and PAD tokens by default to your vocabulary.  See documentation for `non_padded_namespaces` parameter in Vocabulary.
07/09 10:37:15 PM: Your label namespace was 'logic__Existential;Negation'. We recommend you use a namespace ending with 'labels' or 'tags', so we don't add UNK and PAD tokens by default to your vocabulary.  See documentation for `non_padded_namespaces` parameter in Vocabulary.
07/09 10:37:15 PM: Your label namespace was 'logic__Non-monotone'. We recommend you use a namespace ending with 'labels' or 'tags', so we don't add UNK and PAD tokens by default to your vocabulary.  See documentation for `non_padded_namespaces` parameter in Vocabulary.
07/09 10:37:15 PM: Your label namespace was 'logic__Universal;Conjunction'. We recommend you use a namespace ending with 'labels' or 'tags', so we don't add UNK and PAD tokens by default to your vocabulary.  See documentation for `non_padded_namespaces` parameter in Vocabulary.
07/09 10:37:15 PM: Your label namespace was 'logic__Disjunction;Conditionals;Negation'. We recommend you use a namespace ending with 'labels' or 'tags', so we don't add UNK and PAD tokens by default to your vocabulary.  See documentation for `non_padded_namespaces` parameter in Vocabulary.
07/09 10:37:15 PM: Your label namespace was 'logic__Conditionals'. We recommend you use a namespace ending with 'labels' or 'tags', so we don't add UNK and PAD tokens by default to your vocabulary.  See documentation for `non_padded_namespaces` parameter in Vocabulary.
07/09 10:37:15 PM: Your label namespace was 'logic__Temporal'. We recommend you use a namespace ending with 'labels' or 'tags', so we don't add UNK and PAD tokens by default to your vocabulary.  See documentation for `non_padded_namespaces` parameter in Vocabulary.
07/09 10:37:15 PM: Your label namespace was 'logic__Double negation'. We recommend you use a namespace ending with 'labels' or 'tags', so we don't add UNK and PAD tokens by default to your vocabulary.  See documentation for `non_padded_namespaces` parameter in Vocabulary.
07/09 10:37:15 PM: Your label namespace was 'logic__Conjunction'. We recommend you use a namespace ending with 'labels' or 'tags', so we don't add UNK and PAD tokens by default to your vocabulary.  See documentation for `non_padded_namespaces` parameter in Vocabulary.
07/09 10:37:15 PM: Your label namespace was 'logic__Double negation;Negation'. We recommend you use a namespace ending with 'labels' or 'tags', so we don't add UNK and PAD tokens by default to your vocabulary.  See documentation for `non_padded_namespaces` parameter in Vocabulary.
07/09 10:37:15 PM: Your label namespace was 'logic__Conjunction;Upward monotone'. We recommend you use a namespace ending with 'labels' or 'tags', so we don't add UNK and PAD tokens by default to your vocabulary.  See documentation for `non_padded_namespaces` parameter in Vocabulary.
07/09 10:37:15 PM: Your label namespace was 'logic__Intervals/Numbers'. We recommend you use a namespace ending with 'labels' or 'tags', so we don't add UNK and PAD tokens by default to your vocabulary.  See documentation for `non_padded_namespaces` parameter in Vocabulary.
07/09 10:37:15 PM: Your label namespace was 'logic__Universal;Negation'. We recommend you use a namespace ending with 'labels' or 'tags', so we don't add UNK and PAD tokens by default to your vocabulary.  See documentation for `non_padded_namespaces` parameter in Vocabulary.
07/09 10:37:15 PM: Your label namespace was 'logic__Disjunction;Non-monotone'. We recommend you use a namespace ending with 'labels' or 'tags', so we don't add UNK and PAD tokens by default to your vocabulary.  See documentation for `non_padded_namespaces` parameter in Vocabulary.
07/09 10:37:15 PM: Your label namespace was 'logic__Negation;Conditionals'. We recommend you use a namespace ending with 'labels' or 'tags', so we don't add UNK and PAD tokens by default to your vocabulary.  See documentation for `non_padded_namespaces` parameter in Vocabulary.
07/09 10:37:15 PM: Your label namespace was 'logic__Conjunction;Negation'. We recommend you use a namespace ending with 'labels' or 'tags', so we don't add UNK and PAD tokens by default to your vocabulary.  See documentation for `non_padded_namespaces` parameter in Vocabulary.
07/09 10:37:15 PM: Your label namespace was 'logic__Disjunction'. We recommend you use a namespace ending with 'labels' or 'tags', so we don't add UNK and PAD tokens by default to your vocabulary.  See documentation for `non_padded_namespaces` parameter in Vocabulary.
07/09 10:37:15 PM: Your label namespace was 'logic__Disjunction;Conjunction'. We recommend you use a namespace ending with 'labels' or 'tags', so we don't add UNK and PAD tokens by default to your vocabulary.  See documentation for `non_padded_namespaces` parameter in Vocabulary.
07/09 10:37:15 PM: Your label namespace was 'logic__Downward monotone'. We recommend you use a namespace ending with 'labels' or 'tags', so we don't add UNK and PAD tokens by default to your vocabulary.  See documentation for `non_padded_namespaces` parameter in Vocabulary.
07/09 10:37:15 PM: Your label namespace was 'knowledge'. We recommend you use a namespace ending with 'labels' or 'tags', so we don't add UNK and PAD tokens by default to your vocabulary.  See documentation for `non_padded_namespaces` parameter in Vocabulary.
07/09 10:37:15 PM: Your label namespace was 'knowledge__Common sense'. We recommend you use a namespace ending with 'labels' or 'tags', so we don't add UNK and PAD tokens by default to your vocabulary.  See documentation for `non_padded_namespaces` parameter in Vocabulary.
07/09 10:37:15 PM:  Task broadcoverage-diagnostic (train): Saved 1104 instances to /Users/Bowman/Drive/JSALT/superglue-test/preproc/broadcoverage-diagnostic__train_data
07/09 10:37:15 PM:  Task broadcoverage-diagnostic (val): Indexing from scratch.
07/09 10:37:16 PM:  Task broadcoverage-diagnostic (val): Saved 1104 instances to /Users/Bowman/Drive/JSALT/superglue-test/preproc/broadcoverage-diagnostic__val_data
07/09 10:37:16 PM:  Task broadcoverage-diagnostic (test): Indexing from scratch.
07/09 10:37:16 PM:  Task broadcoverage-diagnostic (test): Saved 1104 instances to /Users/Bowman/Drive/JSALT/superglue-test/preproc/broadcoverage-diagnostic__test_data

We should find a workaround ASAP, even if this means (gasp?) following the instructions in the warning.

jeswan commented 4 years ago

Comment by sleepinyourhat Friday Jul 12, 2019 at 15:02 GMT

Closing as redundant, but still an issue. #783