fix the _allgather_base backend issue(issue11)

bytedance / flux

A fast communication-overlapping library for tensor parallelism on GPUs.

Apache License 2.0

223 stars 17 forks source link

fix the _allgather_base backend issue(issue11) #12

Closed zheng-ningxin closed 4 months ago

zheng-ningxin commented 4 months ago

Get following error when torch==2.3.0 Could not retrieve or create the backend 2 for device type cuda Find that, the topo-detection utils may has conflict with it. Therefore comment the topo-utils.