Distributed training?

[rafaelvp-db]

hey - first of all, congrats on the fantastic work!

I'm curious if gradsflow supports distributed training? either using PyTorch's DDP or something like Horovod under the hood.

Thanks!

[github-actions[bot]]

👋 @rafaelvp-db! Thank you for opening your first issue in this repo. We are so happy that you have decided to contribute and value your contribution. Please read these materials before proceeding: Contributing Guide and Code of Conduct.

[aniketmaurya]

Hi @rafaelvp-db, thank you for checking out Gradsflow 😄 ! Gradsflow uses HF Accelerate for distributed training so PyTorch DDP should work. However, this is not in the tests. Created an issue, you can track it here.

[github-actions[bot]]

Stale issue message