Neural Architecture Transfer

Code accompanying the paper.

Neural Architecture Transfer

Zhichao Lu, Gautam Sreekumar, Erik Goodman, Wolfgang Banzhaf, Kalyanmoy Deb, and Vishnu Boddeti

arXiv:2005.05859

Requirements

Python >= 3.7.x, PyTorch >= 1.4.0, timm >= 0.1.18 

ImageNet Classification

python evaluator.py --data /path/to/dataset --model subnets/imagenet/NAT-{M1,M2,M3,M4}/net.config

Architecture Transfer

python evaluator.py \
  --data /path/to/dataset \
  --dataset {aircraft,cars,cifar10,cifar100,cinic10,dtd,flowers102,food101,pets,stl10} \
  --model subnets/{dataset}/net-img@{xxx}-flops@{xxx}-top1@{xx.x}/net.config

Scalability to Objectives

Tri-Objective

12-Objective

Architecture Visualization

Acknowledgement

Codes are modified from OnceForAll and pytorch-image-models