search

facebookresearch / mmf

A modular framework for vision & language multimodal research from Facebook AI Research (FAIR)
https://mmf.sh/
Other
5.5k stars 939 forks source link

Example notebook for running pretrained libraries from the mmf package #525

Closed aryamansriram closed 4 years ago

aryamansriram commented 4 years ago

❓ Questions and Help

Hi, I checked out the tutorial which mentioned running model baselines from the command line. Is there an example notebook which mentions how to use them in code in case you wanted to improve the model?

apsdehal commented 4 years ago

We don't have something specific as you asked for the tutorial. Do you have a model or a dataset in mind? Some context would help us to understand your use case better.

aryamansriram commented 4 years ago

Like if i wanted to use vilbert from mmf using something like from mmf import vilbert Any example of how I can use the model in this way for inference. Also what if I wanted to modify this model

apsdehal commented 4 years ago

Yes, we have a demo that can showcase how to use VisualBERT for inference: https://colab.research.google.com/drive/1Z9fsh10rFtgWe4uy8nvU4mQmqdokdIRR?usp=sharing

You can follow that to modify or adapt.