junxnone / aiwiki

AI Wiki
https://junxnone.github.io/aiwiki
17 stars 2 forks source link

ML AutoML NAS SearchSpace #392

Open junxnone opened 3 years ago

junxnone commented 3 years ago

Search Space

Search Space Description
Entire Structure 完整的网络结构,每层的结构从 search space 中选择,skip-connection 可选
Cell-Based 先搜索表现好的 Cell, 再堆叠 Cell
Hierarchical 分层 增加 Cell 的多样性
Morphism Based 在深度宽度等可变操作上扩展现有模型

Entire & Cell

Search Space Entire-Structured Cell-Based
Figure image image
优缺点 耗时 特征图的大小和通道数变化固定

Hierarchical & Morphism

Search Space Hierarchical (Progressive?) Morphism based
Figure image
image
image

chain & multi-branch

chain-structured neural networks multi-branch networks
image image
junxnone commented 3 years ago

junxnone/tech-io#805