search

SHI-Labs / Neighborhood-Attention-Transformer

Neighborhood Attention Transformer, arxiv 2022 / CVPR 2023. Dilated Neighborhood Attention Transformer, arxiv 2022
MIT License
1.04k stars 85 forks source link

freeze_at be set to 2 to freeze the pretrained weight downloaded from the official website? #89

Closed aihcyllop closed 1 year ago

aihcyllop commented 1 year ago

In the dinated neighborhood transformer, run instance segmentation on coco, How to freeze the pretrained weight downloaded from the official website? Should freeze_at be set to 2?

alihassanijr commented 1 year ago

Thanks for your interest. If you're referring to the mask rcnn experiments, it should be set to 5 to freeze the entire backbone. The default, -1, does not freeze anything, 0 freezes only the patch embedding, 1 is ineffective because there is no absolute positional embedding to be frozen, 2 freezes the first of the 4 transformer encoder blocks, all the way through 5, which would freeze everything.

However, note that if your intention is only to run inference, you do not need to do any of this, and can simply refer to the inference scripts.

alihassanijr commented 1 year ago

Closing due to inactivity. Feel free to reopen if you still have questions.