search

OliverRensu / TinyMIM

149 stars 7 forks source link

finetune with DeiT style #8

Open dulibubai opened 1 year ago

dulibubai commented 1 year ago

Can you provide the details of the model is fine-tuned for 1000 epochs with DeiT-style knowledge distillation? Thanks!

dulibubai commented 1 year ago

How to get the top-1 acc=79.6% in IN-1k with TinyMIM* with DeiT-style knowledge distillation?