search

facebookresearch / AVT

Code release for ICCV 2021 paper "Anticipative Video Transformer"
Apache License 2.0
151 stars 28 forks source link

Unable to initialize from the pretrained model #17

Closed TanviAgg closed 2 years ago

TanviAgg commented 2 years ago

Hi, I am facing an issue while initializing with the pretrained model for the experiment 13_50s_avt.txt (added logs at the end). I believe that the environment setup is correct since the model is running (training without pretrained weights). I have followed the steps mentioned in the readme to download the pretrained models. It would be really helpful if you could share any insight to debug this. Thank you.

Logs

[2021-10-19 22:09:20,194][func.train][WARNING] - Could not init from /user/AVT-main/DATA/pretrained/TIMM/jx_vit_base_patch16_224_in21k-e5005f0a.pth: []
[2021-10-19 22:09:20,195][func.train][WARNING] - Unused keys in /user/AVT-main/DATA/pretrained/TIMM/jx_vit_base_patch16_224_in21k-e5005f0a.pth: ['pre_logits.fc.bias', 'pre_logits.fc.weight', 'head.bias', 'head.weight']
rohitgirdhar commented 2 years ago

Hi, this looks as expected, the head layers are not being initialized as they would differ in size. The code should keep running though, is it crashing at this point?