RTIInternational / gobbli

Deep learning with text doesn't have to be scary.
Apache License 2.0
275 stars 23 forks source link

Generalize multiclass to support multilabel classification #2

Open jasonnance opened 5 years ago

jasonnance commented 5 years ago

Feature

Support multilabel classification instead of just multiclass classification.

Motivation

This would allow a single model to share information about multiple labels instead of training multiple models to learn each individually in a one vs rest paradigm. Could save training time and potentially improve performance on closely related multilabel tasks.

Additional Details

This will probably need to be supported on a per-model basis (via a new type of task? "TrainMultilabel"?), since it will be relatively easy to implement for ex. Transformer/MT-DNN but very difficult for official BERT.