yoyo-nb / Thin-Plate-Spline-Motion-Model

[CVPR 2022] Thin-Plate Spline Motion Model for Image Animation.
MIT License
3.39k stars 555 forks source link

Simple questions #57

Open FurkanGozukara opened 1 year ago

FurkanGozukara commented 1 year ago

I want to animate this picture by using a video that I recorded myself

So what should be the dimension of the video and the source image to animate it best

e.g. example image i want to animate

image

FurkanGozukara commented 1 year ago

I tested vox and it works great

fully animated

the problem is that the framerate is only 20

resolution is very low

can we get higher resolution and framerate?

@yoyo-nb @chenxwh @emmajane1313 @AK391

dangerweenie commented 1 year ago

HI there!

Just getting started with this and I was wondering if you could tell me the steps you used to run the animation - did you simply copy the demo.py and replace the reference image and driving animation?

FurkanGozukara commented 1 year ago

HI there!

Just getting started with this and I was wondering if you could tell me the steps you used to run the animation - did you simply copy the demo.py and replace the reference image and driving animation?

i am planning a tutorial on this hopefully soon on my channel https://www.youtube.com/@SECourses

dangerweenie commented 1 year ago

Thanks!

I managed to get the demo to work - and I noticed the same issue (20fps), though I believe I did see a framerate variable in one of the .py or config files.

EDIT: I'm actually already subscribed to your channel - I followed some tutorials on training models that you posted, thanks so much!

FurkanGozukara commented 1 year ago

Thanks!

I managed to get the demo to work - and I noticed the same issue (20fps), though I believe I did see a framerate variable in one of the .py or config files.

EDIT: I'm actually already subscribed to your channel - I followed some tutorials on training models that you posted, thanks so much!

awesome thank you

baijuexzz commented 1 year ago

Hello FurkanGozukara, how do I handle source images and source videos as data for vox models? I tried a lot of things but it didn't work out. Thank you very much

I want to animate this picture by using a video that I recorded myself

So what should be the dimension of the video and the source image to animate it best

e.g. example image i want to animate

image

Hello FurkanGozukara, how do I handle source images and source videos as data for vox models? I tried a lot of things but it didn't work out. Thank you very much