ljvmiranda921 / calamanCy

NLP pipelines for Tagalog using spaCy
MIT License
44 stars 3 forks source link

why not use roberta-tagalog-large as context vectors #34

Open weixiu00 opened 9 months ago

ljvmiranda921 commented 9 months ago

Mostly a compute issue, but currently working on it as I'm increasing my spending budget next year to make space for RoBERTa Tagalog (large), a decoder-only model, and seq2seq (encoder-decoder) model :)