search

facebookresearch / hiera

Hiera: A fast, powerful, and simple hierarchical vision transformer.
Apache License 2.0
717 stars 36 forks source link

How fine-tune the model? #12

Open SalvatoreRa opened 1 year ago

SalvatoreRa commented 1 year ago

Very nice work,

do you have a sample of code for fine-tuning the model for a task?

Could be possible to fine tune as it was a model from the torch hub?

dbolya commented 1 year ago

Yes, you should be able to fine-tune a torch hub model like normal.

As for how to fine-tune the models, I'd suggest taking a look at the finetuning script in the mae repo. It should be fairly similar to what we did, but you might have to tweak "drop path" and "layer decay" to your specific task.

We will eventually release training code in this repo as well, but we're currently fairly busy so it might take a while.