boun-tabi-LMG / turkish-lm-tuner

Turkish LM Tuner
https://boun-tabi-lmg.github.io/turkish-lm-tuner/
MIT License
76 stars 6 forks source link

Integrating token classification implementation #41

Closed gokceuludogan closed 8 months ago

gokceuludogan commented 8 months ago

The current version of the library fails in token classification datasets: POS and NER.

BERTurk and Turna encoder implementations must be fixed.

gokceuludogan commented 8 months ago

Addressed in #46.

gokceuludogan commented 8 months ago

@furkanakkurt1335 Could you check and test implementation and update POSDatasets accordingly?