IFICL / SLfM

Official code for the paper: [ICCV2023] Sound Localization from Motion: Jointly Learning Sound Direction and Camera Rotation
https://ificl.github.io/SLfM/
MIT License
34 stars 8 forks source link

can't train on resnet 50 #6

Closed deBrian07 closed 8 months ago

deBrian07 commented 8 months ago

Hello, I was trying the preset training with resnet-50. However, the error shows that there's a key not found error, and a size mismatch error. The only thing I changed was in slfm-pretext.py. I've attached the screenshots below. Please take a look. Thank you so much!

image image
IFICL commented 8 months ago

Do you use my provided checkpoints? They are only for ResNet18. If you are retraining the models, pretrain from ImageNet pretrain weights.

deBrian07 commented 8 months ago

Yes, I'm trying to use slfm-pretext.py to retrain the models with resnet50, and the errors occurred.

IFICL commented 8 months ago

Have you had the opportunity to troubleshoot by yourself in order to identify the specific line of code causing this issue? I suspect it's the imagenet pretraining loading issue. Please modify it to meet the torchvision package.

IFICL commented 8 months ago

I have tested it on my end, I don't have this issue. I assume it's likely because of the pytorch and torchvision environment update. Please try to fix this by yourself or use the provided environment yml file.