I followed the second tip here https://github.com/airsplay/lxmert/blob/master/experience_in_pretraining.md and tried to overfit on a small dataset (assumed that running run/lxmert_pretrain.bash with the --tiny flag would do the trick) and the model does not seem to overfit after finishing its 20 epochs. Is this by design?
Could you please provide a log for the pre-training on the tiny sets?
Hi!
I followed the second tip here https://github.com/airsplay/lxmert/blob/master/experience_in_pretraining.md and tried to overfit on a small dataset (assumed that running run/lxmert_pretrain.bash with the --tiny flag would do the trick) and the model does not seem to overfit after finishing its 20 epochs. Is this by design? Could you please provide a log for the pre-training on the tiny sets?
Thanks!