facebookresearch / mmf

A modular framework for vision & language multimodal research from Facebook AI Research (FAIR)
https://mmf.sh/
Other
5.49k stars 935 forks source link

What are the inputs to be provided in pretrained VilBERT model? #1280

Open ApoorvVerma5 opened 1 year ago

ApoorvVerma5 commented 1 year ago

Hello, I loaded pretrained model by the following provided code. from mmf.common.registry import registry

model_cls = registry.get_model_class("vilbert") model = model_cls.from_pretrained("vilbert.finetuned.hateful_memes.direct")

Now, I want to use this model on my dataset but I can't figure out what are the inputs to be provided in the model. These all are the inputs to be given, input_0, input_1, targets, input_mask, segment_ids, return_output_dict, image_info_0 , image_features_0