search

FlagOpen / FlagScale

FlagScale is a large model toolkit based on open-sourced projects.
Other
132 stars 40 forks source link

[AutoTuner]Add memory model #147

Closed Caozhou1995 closed 3 months ago

Caozhou1995 commented 3 months ago

This PR adds memory model, which can be used to speed up pruning and filter out OOM memory strategies and strategies with low memory usage.