Working with pretrained UNITER and Hateful Memes dataset

facebookresearch / mmf

A modular framework for vision & language multimodal research from Facebook AI Research (FAIR)

https://mmf.sh/

Other

5.48k stars 934 forks source link

Open skakar-git opened 3 years ago

skakar-git commented 3 years ago

Is there a tutorial that can guide me how to incorporate pretrained UNITER (from https://convaisharables.blob.core.windows.net/uniter/pretrained/uniter-base.pt) into mmf and then finetune it with HM dataset? I am brand new novice to all this and still coming up to speed, any help/pointer would be helpful! TIA.

hackgoofer commented 3 years ago

@skakar-git,

You would need to create a model class that subclasses the BaseModel class.

Some examples: