henry123-boy / SpaTracker

[CVPR 2024 Highlight] Official PyTorch implementation of SpatialTracker: Tracking Any 2D Pixels in 3D Space
Other
665 stars 19 forks source link

Unexpected keys in state_dict #27

Open jiaqchen opened 1 month ago

jiaqchen commented 1 month ago

Trying to run the code and downloaded the necessary models: dpt_beit_large_384.pt, ZoeD_M12_K.pt, ZoeD_M12_NK.pt

However, now I run into an "unexpected keys in state_dict" error. Are these keys supposed to be initialized in the DPTDepthModel? Could I be doing something wrong? Thanks!

image
m43 commented 1 month ago

Those keys should be there, yes. What is your timm version? Maybe try pip install timm=0.6.7 as timm is used here: https://github.com/henry123-boy/SpaTracker/blob/4e777d14852a83954e0f45a09791cc6888643f95/models/monoD/zoeDepth/midas_c/midas/backbones/beit.py#L9

yccyenchicheng commented 5 days ago

Those keys should be there, yes. What is your timm version? Maybe try pip install timm=0.6.7 as timm is used here:

https://github.com/henry123-boy/SpaTracker/blob/4e777d14852a83954e0f45a09791cc6888643f95/models/monoD/zoeDepth/midas_c/midas/backbones/beit.py#L9

This works for me.