search

cvlab-yonsei / AZ-NAS

An official implementation of "AZ-NAS: Assembling Zero-Cost Proxies for Network Architecture Search" (CVPR 2024) in PyTorch.
GNU General Public License v3.0
43 stars 19 forks source link

The nonconsistent results with NASbench201 #8

Open wrongnames opened 1 month ago

wrongnames commented 1 month ago

Using the code provided by the authors I was unable to get results consistent with those in the paper, with Spearman correlations of only 0.75 (CIfar10), 0.73 (CIfar100), and 0.68 (Imagenet16-120) for the three datasets on NASbench201.

wrongnames commented 1 month ago

image image

wrongnames commented 1 month ago

We supplemented the experimental results obtained. We don’t know where the problem lies. All computation on AZ score used the code provided by the authors.