rmaphoh / RETFound_MAE

RETFound - A foundation model for retinal image
Other
311 stars 63 forks source link

Finetuned result and Evaluation result is different #19

Closed taekwanlee closed 7 months ago

taekwanlee commented 7 months ago

Hello, first of all, thank you so much for sharing this valuable and meaningful research. The results of evaluation differ when using the ''RETFound_cfp_weights.pth'' file for fine-tuning and evaluating, compared to using the ''checkpoint-best.pth'' file saved during fine-tuning. Is the ''checkpoint-best.pth'' file not the best parameter saved during the fine-tuning process of ''RETFound_cfp_weights.pth''?

rmaphoh commented 7 months ago

As answered in email.

"The 'RETFound_cfp_weights.pth' is the model weight obtained by SSL pre-training on unlabelled data, while the 'checkpoint-best.pth' should be the best model weight in fine-tuning. In other words, the 'RETFound_cfp_weights.pth' is the starting point, after epochs of training, you can get a 'checkpoint-best.pth' which fits your downstream task."