Multi-Objective-NAS / self-supervised-nas

Official implementation of the paper "Pretraining Neural Architecture Search Controllers with Locality-based Self-Supervised Learning" (NeurIPSW 2020)
5 stars 0 forks source link

Candidates still ultimately empty #28

Closed bhavna-gopal closed 2 years ago

bhavna-gopal commented 2 years ago

Can you please give us a step by step procedure?

  1. When we run CUDA_VISIBLE_DEVICES={device_index} python3 pretrain.py experiment=AngularLoss we generate some weights in the output folder. We don't see anything with "encoder" in it. We see "embedder", "trunk" and "trunk-optimizer". There are six h5 files in total - each of the above names with "0" and "1" .

  2. Passing in the path for embedder does not work into train.yaml. What should we be passing in here?

  3. How do we run train.py? I am currently running "CUDA_VISIBLE_DEVICES=4 python3 train.py" sometimes I still see that candidates is empty and sometimes it is not. Is this expected? How do I generate the networks generated/ search space as well as the final network selected?

juice500ml commented 2 years ago

Duplicate issue in #28.