microsoft / FocalNet

[NeurIPS 2022] Official code for "Focal Modulation Networks"
MIT License
682 stars 61 forks source link

The speed is relatively slow despite its low MACs. #44

Open ccx1997 opened 1 year ago

ccx1997 commented 1 year ago

We have tried FocalNet in our recognition task, but found it slower than ViT obviously, though it cost much less card memory. Have you found the same problem? I guess it is because the inner detailed operations are not paralleled well.