search

mazurowski-lab / finetune-SAM

This is an official repo for fine-tuning SAM to customized medical images.
https://arxiv.org/abs/2404.09957
Apache License 2.0
114 stars 17 forks source link

the poor performance when i adjust the args.out_size=512 #4

Closed ShChen233 closed 4 months ago

ShChen233 commented 4 months ago

image image Previously, I used the code from the Medical-SAM-Adapter project (https://github.com/KidsWithTokens/Medical-SAM-Adapter) to perform multi-organ segmentation on the Synapse dataset, achieving an average Dice accuracy of 89%. However, after adjusting related parameters in the finetune-SAM project (such as setting out_size=512) and training using the adapter method, I found a significant decrease in the Dice score. Can you provide some advice? Thank you very much.

Guhanxue commented 4 months ago

aha, May i ask if you adjust your output channel of the network?

Also, It might bc current version of dataset/dataloader have not support multi-class segmentation version.

I was using two different dataset.py before but i thought it was not very organized and elegant. Thus i am planning to combine all my dataset related codes into one Class. i am still organize that part of code (i am so sorry for the inconvience). Do you mind giving me around 1 day to update my repo, i will send you an msg when it is fixed.

ShChen233 commented 4 months ago

Thank you very much for your detailed explanation. I have made an adjustment to the output channel of the network by setting the num_classes=args.n_classes. Furthermore, I have recently embarked on a research project involving the adaptation of SAM to multi-organ segmentation. If it's convenient for you, could we possibly exchange contact information, such as WeChat or Email?hhh. Perhaps we can collaborate in the future~

ShChen233 commented 4 months ago

image

Guhanxue commented 4 months ago

cooooool, what is your wechat?

ShChen233 commented 4 months ago

emmm，It may not be convenient to show wechat id under the Issues? hhh. If it's convenient for you, could you provide your email address? My email is shchen@zju.edu.cn

Guhanxue commented 4 months ago

Hi, i updated the support for multi-cls segmentation. Please free feel to test it.

ShChen233 commented 4 months ago

I'm sorry, I forgot that I had updated my email address... It should be 22332040@zju.edu.cn. @Guhanxue 。And thank you very much for your detailed explanation again~