Multiclass Prediction - Githubissues

ys-zong / MEDFAIR

[ICLR 2023 spotlight] MEDFAIR: Benchmarking Fairness for Medical Imaging

https://ys-zong.github.io/MEDFAIR/

56 stars 10 forks source link

Multiclass Prediction #1

Closed XuZikang closed 1 year ago

XuZikang commented 1 year ago

Hello, really impressive work. and how can I use this framework for multiclass classification tasks? For example, using the original label of HAM10000 (7 classes) as target task, rather than spliting the dataset into benign and maglinant?

Thank you!

ys-zong commented 1 year ago

Hi, thanks for your interest. We may try to support this feature in the future. For now, there're a few things to modify:

Change the loss function from BCE to CE.
Set the output layer to 7 instead of 1.
AUC may not be suitable for non-binary tasks. You may want to change it to Acc.

Let me know if you have any other questions~

XuZikang commented 1 year ago

Thank you for your reply!

I'm trying to train models follow your default settings, and there seems some bugs in CFair and LAFTR. Besides, I've figured out some small bugs in DSBN and EnD :)