search

webis-de / small-text

Active Learning for Text Classification in Python
https://small-text.readthedocs.io/
MIT License
547 stars 60 forks source link

small-text for named entity recognition model #22

Closed glahoti6 closed 1 year ago

glahoti6 commented 1 year ago

Can small-text be used with BERT-based NER / token classification model?

chschroeder commented 1 year ago

Unfortunately, it does not support token classification yet.

However, for Transformer Models a rough solution should be achievable with just a few changes to the classifier and query strategies. And the dataset abstraction probably will need to be adapted here and there.

Nevertheless, it's not on my roadmap for the near future but if you anyone wants to try a prototype I would be willing to help.