search

FlagOpen / FlagScale

FlagScale is a large model toolkit based on open-sourced projects.
Other
132 stars 40 forks source link

[Hetero] Fix hang in heterogeneous mode #203

Closed heavyrain-lzy closed 2 weeks ago

heavyrain-lzy commented 3 weeks ago
  1. Fix hang in the heterogeneous mode, where there are more than one proecc_meshse and the tp_size of one of them is 1 and the other is not 1
  2. Fix some other bugs