state-spaces / mamba

Mamba SSM architecture
Apache License 2.0
12.7k stars 1.06k forks source link

When I train with multi-GPU, the `autotuner.py` function in triton pops up `full_nargs = {**self.nargs, **kwargs, **self.best_config.kwargs} TypeError: 'NoneType' object is not a mapping` error #572

Open sugardoll223 opened 1 week ago

sugardoll223 commented 1 week ago

Thank you very much for your excellent work!

But I'm having a problem with mamba2. When I train with multi-GPU, the autotuner.py function in triton pops up full_nargs = {**self.nargs, **kwargs, **self.best_config.kwargs} TypeError: 'NoneType' object is not a mapping error

but when i train with single-GPU, the error doesn't trigger.

It is not necessary to make additional configuration when training with multiple GPUs