search

PaddlePaddle / ERNIE

Official implementations for various pre-training models of ERNIE-family, covering topics of Language Understanding & Generation, Multimodal Understanding & Generation, and beyond.
6.29k stars 1.28k forks source link

ernie-vil pretained performance issue #583

Closed yuewan2 closed 3 years ago

yuewan2 commented 3 years ago

请问ernie-vil vcr-pretrained model 是还需要 fine-tuned 才能达到paper里的效果吗？我这边按照instruction直接用vcr-pretrain base model 做了vcr qa的inference但效果只有20%左右，想知道是什么原因。谢谢！

Screen Shot 2020-10-27 at 22 38 23
TangDonnie commented 3 years ago

是的，vcr-pretrained model是一个pretrained model，是不可以直接预测效果，需要进行finetuning。

yuewan2 commented 3 years ago

感谢解答！