search

automl / nas_benchmarks

BSD 3-Clause "New" or "Revised" License
91 stars 25 forks source link

Reproduce the results #22

Open Littleyezi opened 2 years ago

Littleyezi commented 2 years ago

Hi, Thank you for this work! I would like to ask if I want to reproduce the paper in the paper, do I run the code in experiments_script directly, and the json file obtained is the result described in the paper? Are there any details that I need to pay attention to or need to modify?Looking forward to your reply.

aaronkl commented 2 years ago

Yes, you just need to run the scripts in the experiment_script folder. In the paper we ran each optimizer multiple times (~100 times IIRC) and the figures show the averaged results of all the json files

Littleyezi commented 2 years ago

Thanks for all.😊