search

cgtinker / BlendArMocap

realtime motion tracking in blender using mediapipe and rigify
GNU General Public License v3.0
930 stars 112 forks source link

Why is the pose character I generated tilted, cgt_hip_center does not move, and the action is weird #142

Open fengge111111 opened 1 year ago

fengge111111 commented 1 year ago

Why is the pose character I generated tilted, cgt_hip_center does not move, and the action is weird

cgtinker commented 1 year ago

When using pose detection the hips are the root, use holistic detection otherwise.

No idea, I need more info on what you have done. What's a weird action?

How to reproduce the issue?

fengge111111 commented 1 year ago
Screenshot 2023-03-11 161019

like this

fengge111111 commented 1 year ago

I don't kown how to fix it. i use version 1.6.0. I click "Detect Clip" from movie, Target is "Holistic",Driver is "cgt_driver" , then the "rig' like the picture become tilted

KaijuKoder commented 1 year ago

I did a lot of experimentation with BlendArMocap, FreeMocap, and the web services like Rokoko. There are many.

What I found with all of them is you need to be careful what you are wearing. @fengge111111, the shadow cast on your jacket does indeed make it look (to an AI) like you are leaning forward, which is probably why your rig is. I've found if I wear long socks or long shorts the AIs confuse the length of my shins, and think I'm leaning forward too.

In summary, you need to dress so as not to confuse the AI. Just a T-shirt, and if you are wearing shorts, make sure they are above your knees, and don't wear long socks. I found patterned clothing helps, and don't wear dark colors. If you want to fix a video instead of reshooting it, you can disable the BlendARmocap constraints e.g. on the hips, but it's much easier an faster to start with a clean video to begin with.

@cgtinker, I've been doing some other things, but I'll continue testing BlendARmocap whenever I get a chance. You don't get enough thanks for your effort, so thank you!

fengge111111 commented 1 year ago

Thank you for your answer， I will try it. Hope BlendARmocap will become stronger and stronger！

cgtinker commented 1 year ago

Thanks @KaijuKoder - lots of valuable information! ❤️

What I'd like to add is that the camera shouldn't be tilted, the tilt will result in a rotation - also having the entire body (also the feet) visible helps.