search

mlfoundations / open_clip

An open source implementation of CLIP.
Other
9.93k stars 959 forks source link

What is the max value for unlocked_groups in TimmModel.lock()? I am trying to fine-tune the entire vision tower #866

Closed mikelee-dev closed 4 months ago

mikelee-dev commented 5 months ago

inside of open_clip/src/open_clip /timm_model.py, there is a function TimmModel.lock() which is stated to allow you to fine tune the model by unfreezing the weights in certain layer groups starting from the head of the model.

What is the max value for param unlocked_groups? I would like to fine tune the entire vision tower for my task. Thanks!

Thanks!

rwightman commented 4 months ago

everything is fine-tuned by default, so don't lock if you want to fine-tune the whole tower, freezing works by unlocking groups from the head back, if you don't, freeze there is nothing to worry about unlocking.