meijieru / AtomNAS

[ICLR 2020]: 'AtomNAS: Fine-Grained End-to-End Neural Architecture Search'
Other
224 stars 21 forks source link

Doubt about the Imagenet results with extra modules. #5

Open orashi opened 4 years ago

orashi commented 4 years ago

Both Top-1 and Top-5 accuracies of three distinct models are being improved uniformely with respect to the baseline accuracies after the introduction of the swish activation and SE modules: AtomNAS-A:74.6->76.3 (+1.7), 92.1->93.0 (+0.9) AtomNAS-B:75.5->77.2 (+1.7), 92.6->93.5 (+0.9) AtomNAS-C:75.9->77.6 (+1.7), 92.7->93.6 (+0.9) which is an eye-catching uniformity that rarely appears. Is there a reasonable explaination for this? Thanks very much for your reply!

skylian commented 4 years ago

I would say that is a coincidence. If you run the code again, the results are likely different.