search

megvii-model / SinglePathOneShot

MIT License
259 stars 53 forks source link

Why not shuffle validation data during search #4

Closed ultmaster closed 4 years ago

ultmaster commented 4 years ago

Hi. Thanks for this great repo.

https://github.com/megvii-model/SinglePathOneShot/blob/36eed6cf083497ffa9cfe7b8da25bb0b6ba5a452/src/Search/imagenet_dataset.py#L94

This seems to have produced very unstable validation results.

ZichaoGuo commented 4 years ago

The BN statistics will be calculated by the training data before validation, and all the image in validation data will be tested. So shuffle or not doesn't matter to the results.

ultmaster commented 4 years ago

Sorry. I thought that only a subset of validation data will be tested on.