ali-vilab / VGen

Official repo for VGen: a holistic video generation ecosystem for video generation building on diffusion models
https://i2vgen-xl.github.io
2.9k stars 258 forks source link

Does this code support resume training #114

Open double-fire-0 opened 5 months ago

double-fire-0 commented 5 months ago

The training is break during my training process. Does this code support resume training?

I notice that the code can resume model at https://github.com/ali-vilab/VGen/blob/7ad0f25df50b2c35d7eb95cbabdf772c5b9761c8/tools/train/train_t2v_enterance.py#L154 but it seems that the code doesn't resume the optimizer and scheduler ?

Steven-SWZhang commented 3 months ago

Hello, thanks for your attention and suggestions. We did not load the optimizer during the resuming process, as we usually find that it only takes a few optimization steps to generate normally. You can also implement it with some simple modifications.