hpcaitech / Open-Sora

Open-Sora: Democratizing Efficient Video Production for All
https://hpcaitech.github.io/Open-Sora/
Apache License 2.0
21.48k stars 2.06k forks source link

How can I determine that the number given for the mask_strategy parameter is the best? Are there any methods for this? #373

Closed White-Friday closed 3 months ago

zhengzangw commented 3 months ago

This is only for training. You can see the report for some preliminary results.

zhengzangw commented 3 months ago

If you want to finetune an image-based model from an already trained one, I would suggest 0.5 for not masking, and 0.5 for the rest. If you want to train from scratch, 0.1/0.2 is enough.