D-X-Y / AutoDL-Projects

Automated deep learning algorithms implemented in PyTorch.
MIT License
1.56k stars 281 forks source link

Fail to create the API of NAS-Bench-201 #78

Closed YANGWAGN closed 4 years ago

YANGWAGN commented 4 years ago

First of all, thank you for your excellent work。 When I try to create the API of NAS-Bench-201, there has always been the problem of the process being killed without printing any other messages ? Can you give relevant suggestions about this question? Thank you!

The following is a screenshot of the error message: image

D-X-Y commented 4 years ago

Would you mind to let me know your environment, e.g., Python and PyTorch? In addition, would you mind to check whether your downloaded file has the md5 string lasting with 096897

D-X-Y commented 4 years ago

Temporally closed due to inactive

raphaelmemmesheimer commented 3 years ago

Just some context if someone ends up here. The error throws when you initialize the API but have not enough memory. In my test approximately 28GB are nececarry to initialize the API. On a 16GB machine it could not initialize, on a 32GB it get's tight depending on what is running beside.

D-X-Y commented 3 years ago

@raphaelmemmesheimer Thanks for sharing the information! I'm working optimize the memory cost.

D-X-Y commented 3 years ago

@YANGWAGN @raphaelmemmesheimer Hi, I have optimized the code to be more efficient, please check the document at https://github.com/D-X-Y/AutoDL-Projects/blob/master/docs/NATS-Bench.md#preparation-and-download

In short, NATS-Bench is an extended version of NAS-Bench-201, where we create two search spaces:

by using the following codes, the API can be created by seconds instead of minutes.

from nats_bench import create
api = create(None, 'tss', fast_mode=True, verbose=False)

Please let me know if you have any questions.