Question about the architecture-accuracy pairs data.

chenyaofo / CTNAS

[CVPR 2021] Contrastive Neural Architecture Search with Neural Architecture Comparators

BSD 3-Clause "New" or "Revised" License

39 stars 5 forks source link

Question about the architecture-accuracy pairs data. #5

Closed ShunLu91 closed 3 years ago

ShunLu91 commented 3 years ago

Hello, chenyaofo. Great thanks for your nice work and code! I want to know that how to get the architecture-accuracy pairs. As for NAS-Bench-101, each arch has 3 validation accuracy and test accuracy metrics(by different runs). While in the provided architecture-accuracy pairs file, each arch only has 1 validation accuracy and test accuracy metric. Did you calculate their mean value or only randomly select one to get the architecture-accuracy pairs file?

chenyaofo commented 3 years ago

The mean value.

ShunLu91 commented 3 years ago

Thank you very much!