search

a-r-r-o-w / cogvideox-factory

Memory optimized finetuning scripts for CogVideoX using TorchAO and DeepSpeed
Apache License 2.0
177 stars 16 forks source link

Low-bit memory optimizers, CpuOffloadOptimizer, Memory Reports #3

Closed a-r-r-o-w closed 1 week ago

a-r-r-o-w commented 1 week ago

Testing the CpuOffloadOptimizer sorcery from torchao next