search

nghorbani / moshpp

Motion and Shape Capture from Sparse Markers
Other
201 stars 30 forks source link

fit smal params to animal(cat) mocap data which is manual picked from unity 3d model #3

Open minushuang opened 2 years ago

minushuang commented 2 years ago

Hi, could you give me some advice about how to get the smal parameters with Mosh++ if I have some 3d animation models bought from unity store. (ie:https://assetstore.unity.com/packages/3d/characters/animals/mammals/fully-animated-cats-185493#description)

currently, I manually labeled 53 marker locations which are defined in person smpl-x marker-layout, and the mesh result with mosh++ looks like a person with four cilmbs down on ground, the pose is what we thought it would be except the shape is a person, because of the smpl-x model. we need a smal model rather than a smpl-x for the animals.

besides replacing the smpl-x model with smal, what should I do if I want to fitting the smal params to animal mocap data manual picked from the unity 3d model?

below is a mesh results of cat under smpl-x param model, a person-like cat. image

nghorbani commented 2 years ago

Hi there, super interesting application! we have already implemented animal_dog and animal_horse model in the current repo. the code currently doesnt suppport the cap model. However, feel free to follow the track of how we incorporate these two animal models and follow suit for cat. obviously this would be a new development and not turn-key scenario.

minushuang commented 2 years ago

Hi @nghorbani, I cant find a smal or animal_horse/animal_dog marker vids in marker_vids.py, where the smpl and smplx are in with the marker name and the correspond vertex index like {'ARIEL': 411, 'BHEAD': 384, 'C7': 3470....}, which is needed I think if I want to fit the smal params.

could you mind to offer me the animal_horse/animal_dog marker_vids dict, or give me some instructions about how to get these vertex indexes of the correspond marker name(location)

and please let me know if i have something misunderstand.

many thanks.

minushuang commented 2 years ago

and one more question about the configs opt_weights in moshpp_conf.yaml, there is not a smal or animal_horse/animal_dog key under the opt_weights that we need when fitting a smal model params.

mshooter commented 8 months ago

@minushuang were you able to solve this?