你好，请问SelectiveScanMamba, SelectiveScanCore, SelectiveScanOflex和mamba提出的selective_scan_fn有什么区别吗？

MzeroMiko / VMamba

VMamba: Visual State Space Models，code is based on mamba

MIT License

2.21k stars 143 forks source link

你好，请问SelectiveScanMamba, SelectiveScanCore, SelectiveScanOflex和mamba提出的selective_scan_fn有什么区别吗？ #305

Open melooooody opened 2 months ago

melooooody commented 2 months ago

貌似SelectiveScanOflex效率要高些？

MzeroMiko commented 2 months ago

SelectiveScanMamba is a wrapper of selective_scan_fn. SelectiveScanCore delete some codes in mamba so that the code runs faster. SelectiveScanOflex support input with dtype float16 and output with float32, so that you don't have to convert the input into float32 in advance, which also raises the speed.