search

huawei-noah / Efficient-AI-Backbones

Efficient AI Backbones including GhostNet, TNT and MLP, developed by Huawei Noah's Ark Lab.
4.07k stars 708 forks source link

VIG与VIT的性能开销 #216

Closed Thermaloo closed 1 year ago

Thermaloo commented 1 year ago

作者您好，请问图卷积与Transformer相比，图卷积对显存占用以及速度上有优势吗？

iamhankai commented 1 year ago

相比all-to-all的attention计算，图卷积在理论上说有优势的，但是这需要依赖图卷积的高效底层库实现。

Thermaloo commented 1 year ago

好的，谢谢您的回复。