showlab / Tune-A-Video

[ICCV 2023] Tune-A-Video: One-Shot Tuning of Image Diffusion Models for Text-to-Video Generation
https://tuneavideo.github.io
Apache License 2.0
4.15k stars 377 forks source link

video prediction #55

Closed JWFanggit closed 1 year ago

JWFanggit commented 1 year ago

Hello, your work is very attractive. Can this method be used as a video frame prediction task?

zhangjiewu commented 1 year ago

thank you @JWFanggit for the comment. i believe that extending spatial attention to spatiotemporal, which is one of the core ideas of our method, could benefit general temporal modeling. so yes, i think it can be adapted to other video-related tasks, such as video prediction, completion, interpolation, among others. i look forward to seeing the community's progress in this direction.

JWFanggit commented 1 year ago

Thank you very much for your reply!