feat: support for more ccl operations - Githubissues

cisco-open / pymultiworld

A framework for PyTorch to enable fault management for collective communication libraries (CCL) such as NCCL

Apache License 2.0

15 stars 4 forks source link

feat: support for more ccl operations #22

Closed myungjin closed 3 months ago

myungjin commented 3 months ago

Description

broadcast, all-reduce, reduce, all-gather, gather and scatter are now implemented.

Also, send and recv code is simplified.

Type of Change

[ ] Bug Fix
[x] New Feature
[ ] Breaking Change
[ ] Refactor
[ ] Documentation
[ ] Other (please describe)

Checklist

[ ] I have read the contributing guidelines
[ ] Existing issues have been referenced (where applicable)
[ ] I have verified this change is not present in other open pull requests
[ ] Functionality is documented
[ ] All code style checks pass
[ ] New code contribution is covered by automated tests
[ ] All new and existing tests pass