FreyrS / dMaSIF

Other
193 stars 45 forks source link

Problems regarding loss function and auroc #39

Open WHan-alter opened 1 year ago

WHan-alter commented 1 year ago

Dear Authors,

Thank you for sharing the work and code! I have some problems regarding the AUC-ROC and loss function part. In

https://github.com/FreyrS/dMaSIF/blob/0dcc26c3c218a39d5fe26beb2e788b95fb028896/data_iteration.py#L202-L215

You seemed to sample a random number of positive and negative samples to compute the loss and AUC-ROC. For loss, this could be fine, but regarding the AUC-ROC, did you use the same pipeline for the test dataset when measuring the model performance? If so, what's the performance given the entire surface?

Best, Wenkai