The ENAS algorithm's performance is much better on NATS-Bench than that in NAS-Bench-201.
Here are two main reasons:
In NATS-Bench, we do not accumulate the mean/variance for BN layers, instead, we use the batch mean and batch variance for all BN layers during the search.
The ENAS algorithm's performance is much better on NATS-Bench than that in NAS-Bench-201.
Here are two main reasons: