carlosedubarreto / b3d_mocap_import

addon for blender to import mocap data from tools like easymocap, frankmocap and Vibe
106 stars 14 forks source link

Spine, Neck And Head not Axis Rotating #27

Open CGMikeG opened 2 years ago

CGMikeG commented 2 years ago

Spine, neck, and head not rotating with the model. It took me a while to figure out what was happening. But I keep noticing that shoulder and legs are always twisting. Then I finally decided to add bone group to left and right side of the armature and assign them different color, and turned on axis of the bones. This is when I realize the spine Z axis is not rotating at all. I am not entirely sure yet but I think from Head down to the foot the z axis direction remains the same. This probably explains why the character mesh looks wonky when it starts to tun from front to back. And the foot is still facing the same direction even though it should be facing in a different direction.

carlosedubarreto commented 2 years ago

Depending on what import you are doing, its using the original code from the developer, and I couldnt find how to fix that. Instead I created another method, but they are not so good as the original version.

But maybe both could be used. One for main body movements and the custom method I've created to drive the other movements that not working right with the original method

Thats a long shot on what I think it is happening. But that is hapening using which method to import?

CGMikeG commented 2 years ago

Sorry, I forgot to mention, I was using Mediapipe. My knowledge in coding is extremely limited but is it possible to use the location of say the shoulder or the arms to drive the axis of the spines and other bones to make sure they are always facing the right direction. Also, I use a screen recording on youtube to test it on mediapipe--> Load Video. When I get a chance, I will try to test it on vibe and frankmocap to see if it has the same issue.

carlosedubarreto commented 2 years ago

Probably is possible... But to be honest, I've been trying to make some conversion tool since february, and using the existing tools, and got many limitations. So I noticed that I might need to go to another solution or create my solution (like creating some C++ code), because my own solution for mediapipe, is not really so good the way it is, even remaking everything from scratch (there are 2 versions of import for mediapipe)

So, From what I saw, probably you would have better results with Vibe and easymocap. For me easymocap is the best one, but also more complicated to setup the cameras.

And vibe is better using the its own converter, not the one in mocap_import. I have to add the vibe original converter code to mocap_import...

CGMikeG commented 2 years ago

I think your solution for mediapipe is definitely on the right track, I guess the downside is a solution for the axis issue has to be created. Once that's been solved though you will have one of the best addon for blender/mocap. :D

carlosedubarreto commented 2 years ago

Maybe I can try i some more.... thanks for the feedback