sihyun-yu / PVDM

Official PyTorch implementation of Video Probabilistic Diffusion Models in Projected Latent Space (CVPR 2023).
https://sihyun.me/PVDM
MIT License
287 stars 15 forks source link

Fix the error in the prediction when the first 16 frames are empty. #18

Closed G-U-N closed 1 year ago

G-U-N commented 1 year ago

Hi, thanks for your amazing project! Your paper and codebase really help me a lot.

But I found that you seem to forget to add the mask when the first 16 frames are empty in test_fvd_ddpm. That will cause the conditional value to be all -1 instead of all 0, thus leading to the prediction failure that the model tends to predict dark frames.