chenxin061 / pdarts

Codes for our paper "Progressive Differentiable Architecture Search:Bridging the Depth Gap between Search and Evaluation"
Other
359 stars 83 forks source link

关于一阶优化 #25

Closed hyqyoung closed 4 years ago

hyqyoung commented 4 years ago

我想问下,对结构参数使用一阶优化有速度和精度方面的考量吗?

chenxin061 commented 4 years ago

Sorry for the late reply. The main concern of using the first-order optimization is search cost (speed). Besides, we found that the second-order optimization helps little on the accuracy.