boun-tabi-LMG / turkish-lm-tuner

Turkish LM Tuner
https://boun-tabi-lmg.github.io/turkish-lm-tuner/
MIT License
76 stars 6 forks source link

add pos encoder #57

Closed furkanakkurt1335 closed 8 months ago

furkanakkurt1335 commented 8 months ago

Addition is the function preprocess_classification in tr_datasets.py. I also formatted it, that's why it has a large diff, sorry for that! 🙏

This one includes the commits of the PR #50 as well.