search

cumulo-autumn / StreamDiffusion

StreamDiffusion: A Pipeline-Level Solution for Real-Time Interactive Generation
Apache License 2.0
9.7k stars 692 forks source link

The first two frames of output in `examples/vid2vid` are wired #13

Open discus0434 opened 10 months ago

discus0434 commented 10 months ago

Below might improve the result:

- write_video(output, video_result[2:], fps=fps)
+ write_video(output, video_result[4:], fps=fps)

at https://github.com/cumulo-autumn/StreamDiffusion/blob/b74363e32c5f1f9035cf4fa8b0fd11ab8a3177de/examples/vid2vid/main.py#L99

wangbochao1 commented 10 months ago

how to handle this problem？

https://github.com/cumulo-autumn/StreamDiffusion/issues/31

teftef6220 commented 10 months ago

Thanks for the report.

That part is being fixed by us. Right now we have the initial 2 frames of the output video.

write_video(output, video_result[2:], fps=fps)

Try changing the slice of video_result[2:] like video_result[4:]

This way you can eliminate some of the initial frames.