pixeli99 / TrackDiffusion

Official PyTorch implementation of TrackDiffusion (https://arxiv.org/abs/2312.00651)
61 stars 4 forks source link

Unexpected generated videos.. #7

Closed aimansnigdha closed 2 months ago

aimansnigdha commented 3 months ago

Interesting work! Thanks for sharing.

I have used the T2V-weights and followed demo.ipynb: GT:

gt_gif_005a527edd_1

Generated: output_005a527edd

GT: gt_gif_00917dcfc4_1

Generated: output_00917dcfc4

Please let me know if I should adjust any parameters during testing for better generation. Thanks!

pixeli99 commented 3 months ago

Hi, I checked this issue, and I'm sorry that I set the wrong width and height in the demo. The correct values should be 384,256 instead of 480,320. I will make this correction. output_005a527edd But even if I use the 480, 320 settings, there is no screen flickering; you should check if the unet weights have been loaded correctly? If you have any further questions, please feel free to ask me.