boun-tabi-LMG / turkish-lm-tuner

Turkish LM Tuner
https://boun-tabi-lmg.github.io/turkish-lm-tuner/
MIT License
73 stars 6 forks source link

Implement encoder-only T5 sequence classification #36

Closed zeynepyirmibes closed 5 months ago

zeynepyirmibes commented 6 months ago

Normally T5forSequenceClassification loaded the encoder and the decoder, but this is unnecessary for text classification tasks. To functionally use the "classification" task format, I implemented a T5 classifier that only loads the encoder (taking help from @gokceuludogan's wrapper).

New:

gokceuludogan commented 6 months ago