search

jackroos / VL-BERT

Code for ICLR 2020 paper "VL-BERT: Pre-training of Generic Visual-Linguistic Representations".
MIT License
735 stars 110 forks source link

Pretrained VL-BERT model on bert_based_multilingual_uncased needed to apply zero shot learning for German language #80

Open aggarwalpiush opened 3 years ago

aggarwalpiush commented 3 years ago

Hi,

Thanks for such an awesome library.

I want to apply VL-BERT for different German downstream tasks. Due to data scarcity, I want to use VL-BERT in zero shot settings.

Do you also provide pretrained VL-BERT model where bert_based_multilingual_uncased is used as a textual model as I can see it is planning to use during inference (https://github.com/jackroos/VL-BERT/blob/master/external/pytorch_pretrained_bert/modeling.py#L44). If not, is there a way I can use VL-BERT for the German language?

Thanks, Piush Aggarwal