How to freeze ViT backbone during training?

czczup / ViT-Adapter

[ICLR 2023 Spotlight] Vision Transformer Adapter for Dense Predictions

https://arxiv.org/abs/2205.08534

Apache License 2.0

1.27k stars 140 forks source link

Closed zzzqzhou closed 1 year ago

zzzqzhou commented 1 year ago

I want to freeze ViT backbone during training on some downstream tasks. How can I change the config or the code?

czczup commented 1 year ago

You can write some code on the train.py to freeze ViT backbone, like this code:

zzzqzhou commented 1 year ago

Thanks a lot!