LoicGrobol / zeldarose

Train transformer-based models.
https://zeldarose.readthedocs.io
Other
28 stars 3 forks source link

Add multiling tokenizer training for mBART #80

Open LoicGrobol opened 7 months ago

LoicGrobol commented 7 months ago

As of now we only offer to train monolingual tokenizers, which don't work for mBART.