The function for mergering different patches for the vit students.

Hao840 / OFAKD

PyTorch code and checkpoints release for OFA-KD: https://arxiv.org/abs/2310.19444

81 stars 11 forks source link

The function for mergering different patches for the vit students. #9

Closed liguopeng0923 closed 7 months ago

liguopeng0923 commented 7 months ago

Hi @Hao840 ,

I dont know The function for mergering different patches for the vit students to a fixed patch grids as following.

Hao840 commented 7 months ago

Hi @liguopeng0923,

The patch merging operation is meant to keep added branches lightweight. You can freely change this configuration, but a larger value could result in an OOM error.

liguopeng0923 commented 7 months ago

Thanks for your timely reply! I get it.