uclanlp / visualbert

Code for the paper "VisualBERT: A Simple and Performant Baseline for Vision and Language"
528 stars 104 forks source link

How to retrain VisualBERT on another dataset? #46

Closed Tess314 closed 3 months ago

Tess314 commented 4 months ago

Out-of-the-box VisualBERT is trained on the COCO dataset, and I'd like to retrain it (fine-tune) on my own data so that it retains the original learned model parameters, whilst being updated with the new data.

I'm unsure what section of the code is I need to change.

Jupyter notebook I'm using: https://github.com/huggingface/transformers/blob/main/examples/research_projects/visual_bert/demo.ipynb

Thanks in advance.