search

Luffy03 / Large-Scale-Medical

[CVPR 2024 Extension] 160K volumes (42M slices) datasets, new segmentation datasets, 31M-1.2B pre-trained models, various pre-training recipes, 50+ downstream tasks implementation
Apache License 2.0
101 stars 7 forks source link

Could you provide pre-trained projection head weights for teacher and student models? #14

Closed siny1998 closed 3 weeks ago

siny1998 commented 4 weeks ago

Hi,

I would like to reload the pre-trained model for continued pre-training. However, I noticed that the provided pre-trained weights do not include the projection head weights for the teacher and student models. Could you please provide these, specifically the weights file 'VoCo_B_SSL_head.pt'?

Thank you in advance for your assistance.

Best regards, Siny

Luffy03 commented 4 weeks ago

Hi, thank you very much for your attention to our work. I am a little confused with the meaning of "reload pre-trained models for continued pre-training". What is the purpose? If you want, I can upload them maybe a few days later since my server is not available recently. So sorry for that.

siny1998 commented 4 weeks ago

Thank you for your quick response. I’m interested in reloading your pre-trained weights to continue pre-training on a different modality, such as MRI. I look forward to the updates on the pre-trained weights. Thank you again for your assistance.

Luffy03 commented 4 weeks ago

Ok, I will upload it as soon as possible. But for MRI, it may need to modify some parameters like input_channels.

siny1998 commented 4 weeks ago

Thank you again for your help. I can handle the modification of input channels on my own.

yeerwen commented 3 weeks ago

Hi Linshan,

Fantastic work! I’m very interested in following your research and would appreciate access to the pre-trained weights of your projection heads. Could you please let me know when they might be available? Thank you very much for your response.

Best regards, Yiwen Ye

Luffy03 commented 3 weeks ago

Thank you very much for your attention to our work, which encourages us a lot! I am sorry that in our old implementation, I did not consider that some may need the checkpoints of projection heads. But I do have some old backups for voco_ssl, please take a look at https://pan.baidu.com/disk/main?_at_=1728644991410#/index?category=all&path=%2FVoCo%2Fvoco_ssl, some training logs are also attached. Sincerely hope they can help your research.

yeerwen commented 3 weeks ago

Hi Linshan,

Thank you so much for your quick response. This new checkpoint has been incredibly helpful!

Best regards, Yiwen Ye

yeerwen commented 3 weeks ago

Hi Linshan,

I tried accessing the link you shared, but it seems the files have been deleted. Could you let me know how I might retrieve them? QQ_1730695795895

Best regards, Yiwen Ye

Luffy03 commented 3 weeks ago

Weird. My version is ok. Would you please check it again? image

yeerwen commented 3 weeks ago

Hi Linshan,

I tried again but failed once more.

Best regards, Yiwen Ye

Luffy03 commented 3 weeks ago

I cannot figure out the reasons. Maybe you can try this https://pan.baidu.com/s/1dIIOJT3CkCU_9Wv8djlL8w?pwd=vfkn

yeerwen commented 3 weeks ago

Hi Linshan,

The link you provided works perfectly! Thank you so much!

Best regards, Yiwen Ye

siny1998 commented 3 weeks ago

Thank you very much for providing the weights!