PaddlePaddle / PaddleSlim

PaddleSlim is an open-source library for deep model compression and architecture search.
https://paddleslim.readthedocs.io/zh_CN/latest/
Apache License 2.0
1.56k stars 345 forks source link

DARTS #1664

Open Michael-Fuu opened 1 year ago

Michael-Fuu commented 1 year ago

https://github.com/PaddlePaddle/PaddleSlim/blob/release/2.0.0/docs/zh_cn/api_cn/dygraph/nas/darts.rst#%E5%8F%AF%E5%BE%AE%E5%88%86%E6%A8%A1%E5%9E%8B%E6%9E%B6%E6%9E%84%E6%90%9C%E7%B4%A2darts darts可微分搜索产出一堆模型参数文件(默认会产生50个),他们有什么意义,怎么拿到最优搜索模型结构呢

ceci3 commented 9 months ago

产出的是每个epoch 保存的参数,在log里可以看到对应的Genotype 结构信息,搜索之后对拿到的对model.py做相应的修改进行评估训练。可以参考:https://github.com/PaddlePaddle/PaddleSlim/tree/9a00cbbcc11607839de1abeee8c217b82a07f191/demo/darts#%E8%87%AA%E5%AE%9A%E4%B9%89%E6%95%B0%E6%8D%AE%E9%9B%86%E4%B8%8E%E6%90%9C%E7%B4%A2%E7%A9%BA%E9%97%B4