This PR open sources our latest work on large model training -- Perseus.
The core algorithm for optimization is in lowtime.
PerseusOptimizer is more of a wrapper around the core algorithm and implements the mechanism of fine-grained frequency locking in a way that can be integrated with any training framework.
This PR open sources our latest work on large model training -- Perseus. The core algorithm for optimization is in
lowtime.PerseusOptimizeris more of a wrapper around the core algorithm and implements the mechanism of fine-grained frequency locking in a way that can be integrated with any training framework.