search

ruocwang / darts-pt

[ICLR2021 Outstanding Paper] Rethinking Architecture Selection in Differentiable NAS
Apache License 2.0
102 stars 14 forks source link

Which version of nas-bench-201 does the code use? #1

Closed yuezhixiong closed 3 years ago

yuezhixiong commented 3 years ago

https://github.com/ruocwang/darts-pt/blob/bf3ffdd03f9a4773fee015d5c73a8a38cd0859b7/nasbench201/train_search.py#L394

Here seems missing argument "hp" in api.query_by_arch() according to

https://github.com/D-X-Y/NAS-Bench-201/blob/8558547969c131f75af2725869ff1ece98e98f23/nas_201_api/api_201.py#L118`

Fixed after adding hp argument with 12 or 200 result = api.query_by_arch(genotype, hp='200')

ruocwang commented 3 years ago

We use the previous version: [2020.02.25]. I was not aware that they changed the query function. For the newer version, "hp" should probably be 200. I think the 12-epoch version (hp=12) is reserved only for the search phase of RL/EA-based methods (to reduce the search cost).

Thanks for pointing it out!

yuezhixiong commented 3 years ago

Problem solved. Thanks for replying.