search

YU1ut / MixMatch-pytorch

Code for "MixMatch - A Holistic Approach to Semi-Supervised Learning"
MIT License
633 stars 129 forks source link

Question about the Meaning of Accuracy in the Table Results #14

Closed EveDong closed 2 years ago

EveDong commented 5 years ago

Does the the accuracy in the table Results refer to "Best acc" or "Mean acc" in the code?

xiaopingzeng commented 5 years ago

'Best acc' means the best performance in validation dataset， 'Mean acc' means the mean performance of the last 20 epoch test dataset.

EveDong commented 5 years ago

I mean is the accuracy showed in the result table the best accuracy or the mean accuracy?

nazim1021 commented 5 years ago

That would be the mean accuracy

guixianjin commented 5 years ago

I'm confusing with 'Best accu'. Assuming we have a validation set and a separate test data set, does 'Best accu' not mean the accuracy in test data set of the epoch where the accuracy in validation set is best? It may be lower than the potential best accuracy in test data set if the epoch selected by validation set is not so good. Am I wrong? @xiaopingzeng @EveDong