yanchxx / MoPA

An Blender addon uses ROMP to extract human's 3D poses from image, video or webcam and drive your own 3D character.
MIT License
243 stars 50 forks source link

Could I ask for a detailed instruction on how to change the 3D Character? #9

Closed jakuchuxia closed 2 years ago

jakuchuxia commented 2 years ago

Also, I would like to know if there is a way to replace the 3D Character before I run the script and process the video so that I don't have to manually change it every time?

yanchxx commented 2 years ago

I'm developing a fully automated website so you can give it a try. As for the detailed operation, this requires you to be familiar with Blender, otherwise it will be very difficult for you to handle any problems that arise, so I recommend you to read the lessons I give in the acknowledgements first.

jakuchuxia commented 2 years ago

Thank you for your replying, I will take a try at the website!

DongshengXiao commented 2 years ago

Hi, is there an easy way to replace the 3D characters with just SMPL 3D mesh model? Thanks for your help.

yanchxx commented 2 years ago

Hi, is there an easy way to replace the 3D characters with just SMPL 3D mesh model? Thanks for your help.

You can use this addon to import SMPL and change its name to Armature.

image

The global translation seems to be wrong,you should change the global translation to [0,0,0] in server.py.

image

When the data transfer is complete and SMPL is not in the view I set, select it in the sidebar and press the "/" key(in 3D viewport) to find it.

DongshengXiao commented 2 years ago

Thank you very much for your reply.

jakuchuxia commented 2 years ago

Hi, is there an easy way to replace the 3D characters with just SMPL 3D mesh model? Thanks for your help.

You can use this addon to import SMPL and change its name to Armature.

image

The global translation seems to be wrong,you should change the global translation to [0,0,0] in server.py.

image

When the data transfer is complete and SMPL is not in the view I set, select it in the sidebar and press the "/" key(in 3D viewport) to find it.

I tried your method with a new video, but the model only move in place and doesn't seem to move forward. Also, after I run the addon, the model shifted further away from the original point. This problem still exists after I change the global translation to [0,0,0]. 123 Any help will be appreciated.

yanchxx commented 2 years ago

Changing the global translation to [0,0,0] prevents the model from moving in space. Its initial spatial position is also uncertain, so it can only be found by pressing key / , then CTRL(Command) + Shift +0 (0 on the numpad or open the emulate numpad) to shift the background back. image

As for why the spatial location of this SMPL model is incompatible with my model's spatial location, I guess its root node is root while my model's root node is Pelvis.

So what are you trying to do? My website may be able to solve your problem, if you need, I can help you operate on my website first, with your own model and video.

DongshengXiao commented 2 years ago

image

Hi, can we use the 3D character like this example instead of the demo one? Thank you very much.

yanchxx commented 2 years ago

image

我有点不太理解,用那个插件导入的不是这个SMPL模型吗?只不过材质不太一样,所以显示上有点区别。 然后空间位置我确实也不太理解为什么不对,等我有空的时候再优化一下吧,提供个SMPL模型版本的也可以。

DongshengXiao commented 2 years ago

太感谢了,那会非常有帮助,期待SMPL模型版本。

yanchxx commented 2 years ago

更新了SMPL模型版本了

DongshengXiao commented 2 years ago

太棒了!多谢!!