RoyHirsch / endossl

Code and models for MICCAI23 paper: "Self-Supervised Learning for Endoscopy Video Analysis".
BSD 3-Clause "New" or "Revised" License
11 stars 0 forks source link

The jax_checkpoint about Private Laparoscopy #1

Open isyangshu opened 10 months ago

isyangshu commented 10 months ago

I wanted to express my appreciation for your outstanding work and the valuable insights I gained from reading your paper. It has been an enlightening experience for me.

However, I have a couple of questions that I would like to bring to your attention:

Hope for your reply!

RoyHirsch commented 9 months ago

Thank you for your interest in our project! I'll look deeper into your questions and answer as soon as I can. Can you share the error message you get when trying to load ViT-B Private Laparoscopy model?

isyangshu commented 9 months ago

Thanks for your reply. I can easily use followed code to get the parameters in all the other five links, since I want to use the pre-trained model in Pytorch. from flax.training import checkpoints loaded_params = checkpoints.restore_checkpoint( "xxxxxx/checkpoint_0", target=None, ) load_state_dict = loaded_params["student_weights"] But when I used the code to load "checkpoint_0_vitb" in https://drive.google.com/drive/folders/18-IF-tply94_71_xtMcQCMMhVPRjwdEF. I got "ValueError: Unpack failed: incomplete input". The model in this link is only 200+M, which may be unreasonable.

ZardCAI commented 9 months ago

I meet the same problem of the ViT-B model of the Private Laparoscopy dataset. I guess this may be a upload error caused by network fluctuations? Could the author upload a completed model? Thanks a lot!