search

ys-zong / MEDFAIR

[ICLR 2023 spotlight] MEDFAIR: Benchmarking Fairness for Medical Imaging
https://ys-zong.github.io/MEDFAIR/
60 stars 11 forks source link

Optimizer choice #8

Closed Carco-git closed 5 months ago

Carco-git commented 5 months ago

Hi,

I have read your ICLR paper and found you mentioned that "SGD optimizer is used for all methods and we apply early stopping if the validation worst-case AUC does not improve for 5 epochs.". However, I can only find the Adam Optimizer in your code implementation. Which optimizer should I use to repeat your experiments?

Thanks!

ys-zong commented 5 months ago

Hi, thanks for your interest. For the paper, I used SGD as the optimizer, but later I found that Adam gives similar performance but converges faster especially for smaller datasets. So I changed the code to Adam optimizer in this commit. If you want to reproduce the results, you can use SGD. If you want to have a faster convergence and potentially better performance, you can use Adam.

Carco-git commented 5 months ago

Thank you!