zygmuntz / hyperband

Tuning hyperparams fast with Hyperband
http://fastml.com/tuning-hyperparams-fast-with-hyperband/
Other
591 stars 75 forks source link

Can we use auc or accuracy rather than logloss? #1

Closed jinxin0924 closed 7 years ago

jinxin0924 commented 7 years ago

loss = result['loss'] val_losses.append( loss )

Can we replace the loss with auc if I am more interested in auc? Or logloss will be better even if I care about auc?

zygmuntz commented 7 years ago

Yes We Can! See https://github.com/zygmuntz/hyperband/blob/master/common_defs.py#L69

Since we're minimizing the loss, remember to use 1 - auc