Closed mattdangerw closed 2 years ago
See the following as a template:
https://github.com/keras-team/keras-nlp/blob/master/keras_nlp/models/bert/bert_tasks.py https://github.com/keras-team/keras-nlp/blob/master/keras_nlp/models/bert/bert_tasks_test.py
It might be easiest to wait for https://github.com/keras-team/keras-nlp/issues/405 to start on this.
Working on this.
We should add an
XLMRobertaClassifier
based on theBertClassifier
model. This will wrap theXLMRoberta
model with a classification head.