search

DuGuYifei / PoseDetect2UnityModel

Use MHFormer [CVPR 2022] to do pose estimation and use Unity to control rig of model. (not real-time)
17 stars 3 forks source link

No root transition #1

Open lucasjinreal opened 1 year ago

lucasjinreal commented 1 year ago

MHFormer seems didnt provide root transition, BTW, will it have a metahuman version?

DuGuYifei commented 1 year ago
  1. root: You're right. It doesn't have root transition, because it needs a model contains floor. I read the Facebook repository and it have many constraints if need root transition, so I think it's enough for me to just get the direction of the line between left and right legs.
  2. metahuman: If I understand correctly, you mean do it in the UnReal Engine, right? I do want to do it, too. My plan is using mediapipe (Google). It will provide face, finger, pose real-time estimation with very good results. (The technology of pose estimation in mediapipe called "BlazePose GHUM Holistic". I really recommend this one temporarily.) But my summer holiday is almost over, so I need learn something "useful" for me to find internship (T-T).
DuGuYifei commented 1 year ago

for root transition: I also find this one, I am not sure whether it is useful for you. (https://github.com/Garfield-kh/PoseTriplet)

lucasjinreal commented 1 year ago

@DuGuYifei Mediapipe + Metahuman is exactly I want. Looking forward to your work!