BaguaSys / bagua

Bagua Speeds up PyTorch
https://tutorials-8ro.pages.dev/
MIT License
875 stars 83 forks source link

Add all communication primitives (such as send recv alltoall) to communication module #56

Closed NOBLES5E closed 3 years ago

NOBLES5E commented 3 years ago

Currently there are only broadcast and allreduce: https://bagua.readthedocs.io/en/latest/autoapi/bagua/torch_api/communication/index.html

create-issue-branch[bot] commented 3 years ago

Branch issue-56-Add_all_communication_primitives_such_as_send_recv_to_communication_module created!