search

Doubiiu / DynamiCrafter

[ECCV 2024] DynamiCrafter: Animating Open-domain Images with Video Diffusion Priors
Apache License 2.0
2.09k stars 165 forks source link

1024 model flashes gray #50

Closed taylenhe20240219 closed 3 months ago

taylenhe20240219 commented 3 months ago

Please tell me why the video I generated using the 1024 model flashes gray and the resolution is 576 1024.

Doubiiu commented 3 months ago

Can you show some examples here? Input and output.

taylenhe20240219 commented 3 months ago

111111

https://github.com/Doubiiu/DynamiCrafter/assets/160470261/a0106f18-2f73-4997-ae87-17703c212df6

**Just like this, the video and workflow are all in it

Doubiiu commented 3 months ago

Hi, Did you try to use the 1024_v1 model for interpolation? Currently, we have released the 512_interp model for interpolation (resolution @512x320), while the 1024_v1 (1024x576) and 512_v1 (512x320) models are for single-image-to-video applications.

taylenhe20240219 commented 3 months ago

微信图片_20240327122358 Yes, I am currently using this 1024 model. Do you mean that the 1024 model does not support changes between pictures now? Only a single picture can be turned into a video

Doubiiu commented 3 months ago

微信图片_20240327122358 Yes, I am currently using this 1024 model. Do you mean that the 1024 model does not support changes between pictures now? Only a single picture can be turned into a video

Exactly. As shown in the README, we have released the following models: Image-to-Video: DynamiCrafter1024, DynamiCrafter512, DynamiCrafter256 Interpolation / looping: DynamiCrafter512_interp

But you can still try to use DynamiCrafter512_interp for interpolation of 1024x576 input images, the performance may be degraded.

taylenhe20240219 commented 3 months ago

thank you!!!