search

Garrafao / durel_system_annotators

3 stars 0 forks source link

sub token handling #1

Closed Garrafao closed 8 months ago

Garrafao commented 1 year ago

currently the XLMR naïve annotator throws an error if it finds no sub-tokens in the specified index range. This should be changed to label such an instance with np.nan.

Garrafao commented 8 months ago

Irrelevant after #16.