Closed zc-alexfan closed 5 months ago
The file is indeed in the training data.
But the warning still appears. Does this affect the performance?
Use load_from_local loader
The model and loaded state dict do not match exactly
unexpected key in source state_dict: backbone.blocks.0.mlp.experts.0.weight, backbone.blocks.0.mlp.experts.0.bias, backbone.b
locks.0.mlp.experts.1.weight, backbone.blocks.0.mlp.experts.1.bias, backbone.blocks.0.mlp.experts.2.weight, backbone.blocks.0
.mlp.experts.2.bias, backbone.blocks.0.mlp.experts.3.weight, backbone.blocks.0.mlp.experts.3.bias, backbone.blocks.0.mlp.expe
rts.4.weight, backbone.blocks.0.mlp.experts.4.bias, backbone.blocks.0.mlp.experts.5.weight, backbone.blocks.0.mlp.experts.5.b
ias, backbone.blocks.1.mlp.experts.0.weight,
...
Hi, i am meeting the same issue, have you solved this problem?
No unfortunately
I have removed the dependency on the vitpose_backbone.pth
file for the demo code. Please pull again the latest version.
The key mismatch warning is on the side of the ViTPose model we use for localizing the hand in the image. This warning is expected, so it shouldn't worry you.
Thanks for the great work.
I was trying to run the demo code and encountered this:
I ran
fetch_demo_data.sh
and it should have the data for demo purposes. Do I also need to runfetch_training_data.sh
to gethamer_training_data/vitpose_backbone.pth
? But the training data is huge.Therefore, I commented out this and the code runs with the following warning in state_dict:
My current assumption is that: I still need to download the training data to get the pretrained backbone so that the state_dict warning disappear to obtain the full-performing model. Is this correct?