Lightning-Universe / lightning-Horovod

Lightning Training strategy for Horovod
Apache License 2.0
1 stars 1 forks source link

Latest Pytorch Lightning and Horovod incompatible #16

Open mhamilton723 opened 1 year ago

mhamilton723 commented 1 year ago

Description & Motivation

Thanks for your work on this lovely library.

Looking to use horovod with the latest version of pytorch lightning. However it seems they are incompatible and cannot be updated. Raised an issue against horovod to track this as well.

https://github.com/horovod/horovod/issues/3896

Pitch

Work with horovod to make sure it can use the latest PyTorch lightning (curreently it depends on <1.5)

Alternatives

No response

Additional context

No response

cc @borda

github-actions[bot] commented 1 year ago

Hi! thanks for your contribution!, great first issue!

awaelchli commented 1 year ago

Hey @mhamilton723 I transferred this issue from the main Lightning repo to our external package here where the HorovodStrategy lives now. It would be great if the HorovodStrategy could be kept updated. We would likely need the help from the community to keep it going, so any contributions are appreciated (updating tests, fixing bugs, documenting reproducible bugs, update apis etc. all welcome).