search

hezarai / hezar

The all-in-one AI library for Persian, supporting a wide variety of tasks and modalities!
https://hezarai.github.io/hezar/
Apache License 2.0
885 stars 53 forks source link

Add data collator for sequence labeling #44

Closed arxyzan closed 1 year ago

arxyzan commented 1 year ago

Add the sequence labeling data collator class as hezar.data.data_collators.SequenceLabelingDataCollator() This class would be a reimplementation of the class transformers.data.data_collator.DataCollatorForTokenClassification()

arxyzan commented 1 year ago

Done in f0902e2