search

facebookresearch / NASViT

code for NASViT
Other
66 stars 3 forks source link

Is there dynamic network original VIT? #5

Closed wmkai closed 2 years ago

wmkai commented 2 years ago

Hi, thanks for the great work! I want to make some changes to the supernet, but I found the dynamic network is not for an original VIT. So I wonder whether there is a code for original VIT.

wmkai commented 2 years ago

And I also want to know the meaning of rescale_idx of transformer block and how to get active subnet of transformer block because I didn't find the get_active_subnet function of transformer block.

wmkai commented 2 years ago

I wonder whether the transformer part of the network is fixed during traning because I didn't find the code that change the settings of transformer.