search

mayuelala / FollowYourPose

[AAAI 2024] Follow-Your-Pose: This repo is the official implementation of "Follow-Your-Pose : Pose-Guided Text-to-Video Generation using Pose-Free Videos"
https://follow-your-pose.github.io/
MIT License
1.25k stars 90 forks source link

How to make pose video? #8

Closed arijin closed 1 year ago

arijin commented 1 year ago

I want make the pose video like the mov in pose_example. What tool should i use?

mayuelala commented 1 year ago

Hi，You could make the pose video by mmpose，the url is mmpose , we detect the skeleton by HRNet[1]. You just need to run the video demo to obtain the pose video. Remember to replace the background with black.

To facilitate sampling, we are going to integrate the skeleton detector into FollowYourPose, stay tuned !

[1] Ke Sun, Bin Xiao, Dong Liu, and Jingdong Wang. Hrnet: Deep high-resolution representation learning for human pose estimation. In Proceedings of the IEEE/CVF Conference

amirothman commented 1 year ago

Remember to replace the background with black.

How does one achieve this?

vinthony commented 1 year ago

you may need the tools from here: https://huggingface.co/spaces/fffiloni/video2mmpose