wangqinsi1 / MathNAS

This is Official PyTorch implementation for 2023-NeurIPS-MathNAS: If Blocks Have a Role in Mathematical Architecture Design.
33 stars 2 forks source link

Missing dependencies and more #3

Closed domenicoMuscill0 closed 3 months ago

domenicoMuscill0 commented 5 months ago

Hi, i was trying to reproduce the results using Google Colab (here) i faced many minor problems:

  1. It was not specified to add timm and yacs in the installation procedure
  2. I get tracebacks while running nasvit because the file "MathNAS/valide/NASViT/misc/attentive_nas_eval.py" is malformed (a for istruction without proper indentation at line 34)
  3. Running main.py in nas mode on nasbench201 gives a predicted accuracy of 11.5% with this architecture "|avg_pool_3x3\~0|+|avg_pool_3x3\~0|avg_pool_3x3\~1|+|avg_pool_3x3\~0|avg_pool_3x3\~1|avg_pool_3x3\~2|" whichever latency and energy constraint i add and with every gpu type i choose.
  4. I cannot predict the accuracy of the supertransformer on raspberrypi since there is an error with the list indexing performed at line 26 of MathNAS/predict.py
Ah-miu commented 4 months ago

Hi, thank you for your interest in MathNAS and for attempting to reproduce our results. We appreciate you bringing these four issues to our attention. We have made the corresponding modifications to address them and have validated the changes in a new environment. If you encounter any further problems, please feel free to reach out to us. :)