DARTS top model exported with 0 parameters

microsoft / nni

An open source AutoML toolkit for automate machine learning lifecycle, including feature engineering, neural architecture search, model compression and hyper-parameter tuning.

https://nni.readthedocs.io

MIT License

14k stars 1.81k forks source link

DARTS top model exported with 0 parameters #5649

Open ekurtgl opened 1 year ago

ekurtgl commented 1 year ago

Describe the issue:

Hi,

I implemented DARTS on my own model and can observe the optimization process fine. After the experiment finishes running, I am exporting the top model for the final retraining, but it looks like it has 0 parameters, so my optimizer throws error. Do you have any idea on what might be the problem? Thanks.

matluster commented 1 year ago

p.numel() instead of p.numel?

flower997 commented 1 year ago

Excuse me,I want to ask a question, during running "from nni.nas.nn.pytorch import LayerChoice, ModelSpace, MutableDropout, MutableLinear" in the file "examples/tutorials/hello_nas.py",I can't find MutableDropout and MutableLinear.How to save it,thank you.