search

icatcherplus / icatcher_plus

iCatcher+: Robust and automated annotation of infant gaze from videos collected in laboratory, field, and online studies
GNU General Public License v3.0
17 stars 19 forks source link

Issues with icatcher+_models #5

Closed hagi-hara closed 2 years ago

hagi-hara commented 2 years ago

I have questions about the models & weights. According to the instruction, these seem to be icatcher_model.pth and face_classifier.pth but we couldn't find them.

If I want to perform the iCatcher+ with pre-trained models and weights, which files should be used (I guess I should use icatcher+_lookit.pth and face_classifier_lookit_weights_best.pt)?

Also, when I specified face_classifier_lookit_weights_best.pt following --fc_model, the code didn't terminate properly although the output files were exported (it kept running). If we renamed the file from .pt to .pth, it ended as we expected.

We'd appreciate it if you could answer those issues. Thanks!

yoterel commented 2 years ago

I have questions about the models & weights. According to the instruction, these seem to be icatcher_model.pth and face_classifier.pth but we couldn't find them.

All models are downloadable using the link provided under step 3 in the README file. We just added the Senegal model as well (trained on children in Senegal).

If I want to perform the iCatcher+ with pre-trained models and weights, which files should be used (I guess I should use icatcher+_lookit.pth and face_classifier_lookit_weights_best.pt)?

Your guess is correct ! for lookit-style experiments please use these files for the model, and fc_model arguments. If you are running iCatcher+ on videos more similar to a lab setting, consider using the cali-bw models.

Also, when I specified face_classifier_lookit_weights_best.pt following --fc_model, the code didn't terminate properly although the output files were exported (it kept running). If we renamed the file from .pt to .pth, it ended as we expected.

This is strange, it doesn't reproduce on 2 of my machines (Windows & Linux). are you providing it with the exact path to the file? if you placed it under the models folder you should be passing: --fc_model models/face_classifier_lookit_weights_best.pt To avoid confusion, I changed the suffix of all model files to be pth - feel free to re download them (same files). Though this shouldn't affect anything.

Also, can you please provide extra detail so that I might be able to reproduce this? what is the command line argument you use, which OS and what python version are you using (and if you use a virtual env, please post its library versions). Also just to clarify, can you please send the exact error you get when the code does not terminate properly? (and if possible, the call stack).

yoterel commented 2 years ago

Were you able to solve this issue ?

hagi-hara commented 2 years ago

Thank you for replacing the files! The problem has been solved perfectly.