[ICLR 2021] "Neural Architecture Search on ImageNet in Four GPU Hours: A Theoretically Inspired Perspective" by Wuyang Chen, Xinyu Gong, Zhangyang Wang
MIT License
167
stars
31
forks
source link
Can not get the same architecture with same random seed and setting #23
Hi. I am run the commands for darts benchamrk search cifar10, but I got different result. The only difference is that because I need to update pytoch version for my gpu is not 1080ti and pytorch updates their methods for computing eigenvalues in later version, I changed https://github.com/VITA-Group/TENAS/blob/9df78ffd98573035375b12e19b9007578cc4155d/lib/procedures/ntk.py#L58 to torch.linalg.eigh, but the result geotype is differnt:
Hi. I am run the commands for darts benchamrk search cifar10, but I got different result. The only difference is that because I need to update pytoch version for my gpu is not 1080ti and pytorch updates their methods for computing eigenvalues in later version, I changed https://github.com/VITA-Group/TENAS/blob/9df78ffd98573035375b12e19b9007578cc4155d/lib/procedures/ntk.py#L58 to
torch.linalg.eigh
, but the result geotype is differnt:which in DART_evaluation give me 96.79% test accuracy. Do you know the reason behind it?