search

FlagOpen / FlagScale

FlagScale is a large model toolkit based on open-sourced projects.
Other
132 stars 40 forks source link

[AutoTuner]Optimize prune and fix some bugs #140

Closed Caozhou1995 closed 3 months ago

Caozhou1995 commented 3 months ago

In this PR, we optimize prune rules:

  1. adding prune rules based on tp and pp
  2. adding dist optimizer rules
  3. adding Multi-Dimensional joint rules. Pruning rules now cover dist optimizer, mbs, sp, recompute, tp, pp, and any combination between them