Weifeng-Chen / control-a-video

Official Implementation of "Control-A-Video: Controllable Text-to-Video Generation with Diffusion Models"
GNU General Public License v3.0
359 stars 26 forks source link

Signle Character #9

Open p0mad opened 1 year ago

p0mad commented 1 year ago

Hi, Is it possible to generate a single character from the Pose for about 5 seconds?

I have a video of Pose ( openpose + hands + face) and i was wondering if it is possible to generate an output video with the length of 5 seconds that has a consistent character/Avatar which plays Dance, .... from the controlled (pose) input? i want to generate human like animation (No matter what, but just a consistent Character/Avatar) Sample Video

Thanks Best regards

Weifeng-Chen commented 1 year ago

I think it is possible, but currently the pose-video dataset maynot be available, it takes time to collect such a dataset.