Weifeng-Chen / control-a-video

Official Implementation of "Control-A-Video: Controllable Text-to-Video Generation with Diffusion Models"
GNU General Public License v3.0
359 stars 26 forks source link

Residual-Based Noise Initialization #21

Closed hzlhzlhzlhzl closed 1 year ago

hzlhzlhzlhzl commented 1 year ago

Hello author, I found that the inference code(inference.py) you provided will not perform this step.

lzhangbj commented 10 months ago

I also have the same question. At inference, groundtruth images are not provided, so how does the model apply residual-based noise initialization?