wengjiangwei / MambaLLIE

Apache License 2.0
5 stars 0 forks source link

How to calculate flops and params #2

Open Zzhy2000 opened 1 week ago

Zzhy2000 commented 1 week ago

Hello, I would like to ask how the flops and params of your model are calculated. Looking forward to your reply.

wengjiangwei commented 1 week ago

Hi,

Thank you for your question! You can use the following Package to calculate FLOPs and Params :

from fvcore.nn import FlopCountAnalysis

Best regards,

Waynejones

Zzhy2000 commented 1 week ago

Sorry to bother you, may I ask how the flops and params in the mamba section are calculated directly through FlopCountAnalysis