ali-vilab / videocomposer

Official repo for VideoComposer: Compositional Video Synthesis with Motion Controllability
https://videocomposer.github.io
MIT License
892 stars 80 forks source link

Keypoin or skelton video generation! #4

Open p0mad opened 1 year ago

p0mad commented 1 year ago

Is there any plan to add keypoint or skeleton sequence based human video generation?

Steven-SWZhang commented 1 year ago

Hello, we will take your valuable feedback into consideration and consider adding skeleton-driven human video generation in the next version. Thank you.

p0mad commented 1 year ago

@Steven-SWZhang, Great I do recommand using either OSX https://osx-ubody.github.io/ or https://github.com/wholebody3d/wholebody3d they have used UBody Dataset UBody is a large-scale Upper-Body dataset with the following annotations: 2D whole-body keypoints ,...

p0mad commented 1 year ago

when do you think V2 would be released?

Steven-SWZhang commented 1 year ago

Thanks for your suggestions, and we will try them out carefully. As for the specific time of open sourcing, we do not have a clear plan yet, but it is already in progress.