search

sczhou / Upscale-A-Video

[CVPR 2024] Upscale-A-Video: Temporal-Consistent Diffusion Model for Real-World Video Super-Resolution
Other
948 stars 44 forks source link

did Upscale-A-Video upscale one frame only or it use data from previous and next frames to increase quality and preserve coherence? #3

Closed fgtm2023 closed 7 months ago

fgtm2023 commented 9 months ago

Peace, did Upscale-A-Video upscale one frame only or it use data from previous and next frames to increase quality and preserve coherence? and if it uses previous and next frames in upscaling, did it will be an option to choose how many frames will be used to enhance one frame? I'm looking forward to using the program soon.

sczhou commented 8 months ago

Hi @fgtm2023, Upscale-A-Video takes the adjacent 8 frames for a single feed-forward pass to ensure temporal consistency and coherence of the results. This means that the upscaling process doesn't only focus on a single frame independently but considers information from both the previous and next frames in the sequence. This aims to enhance the quality of individual frames while preserving smooth transitions between them.

fgtm2023 commented 7 months ago

Hi @fgtm2023, Upscale-A-Video takes the adjacent 8 frames for a single feed-forward pass to ensure temporal consistency and coherence of the results. This means that the upscaling process doesn't only focus on a single frame independently but considers information from both the previous and next frames in the sequence. This aims to enhance the quality of individual frames while preserving smooth transitions between them.

great news, thanks a lot for reply, hope we can use this great program soon 🤞🤞🤞🤞