Switch pretrained Decoder(for example, uses RoBERTa-xlm to replace mBART)

clovaai / donut

Official Implementation of OCR-free Document Understanding Transformer (Donut) and Synthetic Document Generator (SynthDoG), ECCV 2022

https://arxiv.org/abs/2111.15664

MIT License

5.75k stars 466 forks source link

Switch pretrained Decoder(for example, uses RoBERTa-xlm to replace mBART) #112

Open hzhuangdy opened 1 year ago

hzhuangdy commented 1 year ago

You guys did a great job in VDU field. Congratulations! By the way, I wonder if I can replace the mBART by RoBERTa-XLM on finetune process without doing pretraining jobs again?

sudhitpanchal commented 11 months ago

You got succes in this?

hzhuangdy commented 11 months ago

No, I didn't.

@.***

From: sudhitpanchal Date: 2023-10-16 16:05 To: clovaai/donut CC: hzhuangdy; Author Subject: Re: [clovaai/donut] Switch pretrained Decoder(for example, uses RoBERTa-xlm to replace mBART) (Issue #112) You got succes in this? — Reply to this email directly, view it on GitHub, or unsubscribe. You are receiving this because you authored the thread.Message ID: @.***>