rmaphoh / RETFound_MAE

RETFound - A foundation model for retinal image
Other
311 stars 63 forks source link

Fine-tune for downstream regression task (continuous labels) #13

Closed Fragola7 closed 8 months ago

Fragola7 commented 8 months ago

Hi, thanks for your excellent work!

In the paper, you provide examples where the model is fine-tuned for downstream classification tasks (either binary diseases or multi-class labels). Is it possible to use the same framework but to fine-tune on continuous labels, for example predicting systolic blood pressure from fundus images? If so, could you please provide guidelines on how this should be done?

rmaphoh commented 8 months ago

Thanks. This can be done by defining a prediction head in model_vit.py. The loss function should be revised accordingly.

I currently have no bandwidth to add this function, but probably will do it in the coming months

Fragola7 commented 8 months ago

Thanks for your answer! I will look into it.