Open yuweihao opened 3 months ago
Thank you very much! May I ask how you draw those colored squares for matrices? It looks like latex, but I could not find related latex code online. Thank you again!
Hi @WowLucy, I used draw.io and just clumsily assembled the small squares into a matrix.
Cool. Thank you!
Hi, the tutorial looks great! What tool did you use to create this PDF?
Hi @Yubel426 , thank you! I used draw.io to create it.
Hi everyone, Someone asked me how to compute Transformer FLOPs (Equation 6 in the paper). I wrote a tutorial and hope it can help. Feel free to offer feedback so that I can improve it.![transformer_FLOPs](https://github.com/yuweihao/MambaOut/assets/15921929/85fd3733-7a2b-4899-8cd4-24aa53ba7c12)
You can also refer to PDF version.