search

jxiw / MambaInLlama

Official Repository of The Mamba in the Llama: Distilling and Accelerating Hybrid Models
https://arxiv.org/abs/2408.15237
Apache License 2.0
169 stars 12 forks source link

could you share the version of accelerate and deepspeed? #2

Closed hanlinxuy closed 2 months ago

hanlinxuy commented 2 months ago

I am using accelerate==0.33.0 and deepspeed==0.15.0 but got error below, could you share your version? thank you very much!

[rank0]:     self.deepspeed_engine_wrapped.backward(loss, **kwargs)
[rank0]:     ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
[rank0]: AttributeError: 'Accelerator' object has no attribute 'deepspeed_engine_wrapped'
jxiw commented 2 months ago

I use accelerate==0.33.0 and deepspeed==0.12.2. if you have any further questions, please let me know.