Open King4819 opened 4 months ago
Hi, I want to ask that is there any specific reason for the token keep ratio setting ?
[1, 1, 1, 0.7, 0.7, 0.7, 0.7^2, 0.7^2, 0.7^2, 0.7^3, 0.7^3, 0.7^3] for DeiT 12 layers
Is it related to prune FLOPs ratio, such as keep ratio 0.7 will get approximately prune FLOPs ratio of 30%
Thanks !!!
Hi, I want to ask that is there any specific reason for the token keep ratio setting ?
[1, 1, 1, 0.7, 0.7, 0.7, 0.7^2, 0.7^2, 0.7^2, 0.7^3, 0.7^3, 0.7^3] for DeiT 12 layers
Is it related to prune FLOPs ratio, such as keep ratio 0.7 will get approximately prune FLOPs ratio of 30%
Thanks !!!