Changing expansion_factor resulted in 'c10::DistBackendError

state-spaces / mamba

Mamba SSM architecture

Apache License 2.0

13.1k stars 1.11k forks source link

Open ScottHoang opened 3 months ago

ScottHoang commented 3 months ago

Are there any dimensional constraints when using expansion_factor? i.e., the dimension must be multiple of something? Thanks!

tridao commented 3 months ago

Not that i'm aware of, but usually you want dimensions to be multiple of 128 or 256 anyway.