search

FrancescoSaverioZuppichini / detector

14 stars 0 forks source link

Token Merging to create different sizes models #2

Open FrancescoSaverioZuppichini opened 1 year ago

FrancescoSaverioZuppichini commented 1 year ago

I want to add/experiment with Token Merging to create different models sizes. However, is not possible to easy add it if you use nn.MultiHeadAttention but some ideas are presented in this issue