DARTS, one of the Neural Architecture Searches methods, often degrades accuracy because it select often skipping connections, but they proved theoretically that this is because the convergence speed is faster than other operations such as Conv. Furthermore, they proposed a PR-DARTS that prevent it and confirmed that the accuracy of the PR-DARTS was improved.
TL;DR
DARTS, one of the Neural Architecture Searches methods, often degrades accuracy because it select often skipping connections, but they proved theoretically that this is because the convergence speed is faster than other operations such as Conv. Furthermore, they proposed a PR-DARTS that prevent it and confirmed that the accuracy of the PR-DARTS was improved.
Why it matters:
Paper URL
https://arxiv.org/abs/2006.16537
Submission Dates(yyyy/mm/dd)
2020/06/30
Authors and institutions
Pan Zhou Caiming Xiong Richard Socher Steven C.H. Hoi
Methods
Results
Comments