I used this command "python run.py with data_root=/data2/dsets/dataset num_gpus=8 num_nodes=1 task_finetune_irtr_f30k_randaug per_gpu_batchsize=4 load_path="weights/vilt_200k_mlm_itm.ckpt"" to fine-tuned VILT on Flickr30k dataset, but I noticed that the model weights are not updating. Below are the VILT partial weight parameters output at each step. What could be the possible reasons causing this issue?
I used this command "python run.py with data_root=/data2/dsets/dataset num_gpus=8 num_nodes=1 task_finetune_irtr_f30k_randaug per_gpu_batchsize=4 load_path="weights/vilt_200k_mlm_itm.ckpt"" to fine-tuned VILT on Flickr30k dataset, but I noticed that the model weights are not updating. Below are the VILT partial weight parameters output at each step. What could be the possible reasons causing this issue?