Pre-train the BART - Githubissues

moussaKam / BARThez

A french sequence to sequence pretrained model

Apache License 2.0

57 stars 11 forks source link

Closed cahya-wirawan closed 3 years ago

cahya-wirawan commented 3 years ago

Hi,

Do you have a script to pre-train the BART model? I read your documentation, but I can’t find it. Thanks.

Cahya

moussaKam commented 3 years ago

Hi @cahya-wirawan, the pretraining is carried out using Fairseq framework.

Check the denoising task that is used to pretrain Bart.