Open jbischof opened 1 year ago
References:
tensorflow/models
has BertSpanLabeler
: https://www.tensorflow.org/tfmodels/nlp#span_labeling_modelBertForQuestionAnswering
: https://huggingface.co/docs/transformers/model_doc/bert#transformers.BertForQuestionAnswering
BertClassifier
supports one output for the entire input sequence, but span labeling is an important research benchmark. This will require some scoping and design:BertSpanLabelingPreprocessor
or just a more complicated label to pass through?BertSpanLabeler
task model with the correct task-specific layers and preprocessing.