MzeroMiko / VMamba

VMamba: Visual State Space Models,code is based on mamba
MIT License
2.07k stars 124 forks source link

The FLOPs counting problem #170

Open Huskyii24 opened 5 months ago

Huskyii24 commented 5 months ago

Unsupported operator prim::PythonOp.CrossScanTriton encountered 15 time(s) Unsupported operator prim::PythonOp.CrossMergeTriton encountered 15 time(s)

When i am testing the flops of the model, i have these information on the terminal。I found that these are implemented with triton,and there doesn't seem to be much computation in it,

Does this mean that FLOPs can be ignored for these operators?

MzeroMiko commented 5 months ago

Yes they can be ignored as they are all about transpose and flip,and the key operations are just malloc and copy.