feat: concurrent world initialization - Githubissues

cisco-open / pymultiworld

A framework for PyTorch to enable fault management for collective communication libraries (CCL) such as NCCL

Apache License 2.0

15 stars 4 forks source link

feat: concurrent world initialization #21

Closed myungjin closed 4 months ago

myungjin commented 4 months ago

Description

We enable concurrent world initialization by using asyncio's run_in_executor and concurrent.futures.ThreadPoolExecutor.

Type of Change

[ ] Bug Fix
[x] New Feature
[ ] Breaking Change
[ ] Refactor
[ ] Documentation
[ ] Other (please describe)

Checklist

[ ] I have read the contributing guidelines
[ ] Existing issues have been referenced (where applicable)
[ ] I have verified this change is not present in other open pull requests
[ ] Functionality is documented
[ ] All code style checks pass
[ ] New code contribution is covered by automated tests
[ ] All new and existing tests pass