gnina / models

Trained caffe models
81 stars 23 forks source link

Doubt about why using ProBiS #34

Open JonasLi-19 opened 1 year ago

JonasLi-19 commented 1 year ago

I find in the paper that ProBis is used to avoid highly-similar target appear both in TRAIN and TEST files. But what is the point of totally avoiding the test-set has similar target with train-set? I argue that it would make the evaluation on test more difficult than it should be.

I mean, does other scoring functions use the same methods to train model? If not, how could you contrast gnina with them?

dkoes commented 1 year ago

The goal is to be able to generalize to new targets.