zju3dv / EasyMocap

Make human motion capture easier.
Other
3.71k stars 457 forks source link

Visualisizer with SMPLX-model possible? #32

Closed FrankSpalteholz closed 3 years ago

FrankSpalteholz commented 3 years ago

Hello, after trying different options inside of o3d_scene.yml i could only get the skeleton model to run. I assume i must change some arguments for:

body_model: module: "easymocap.visualize.skelmodel.SkelModel" args: body_type: "body25" <- bodyhand? (but its not working, i was checking config.py for this but i guess i made some mistakes) joint_radius: 0.02 gender: "neutral" model_type: "smpl" <- smplh or smplx? (not working either)

On your example-page there is an animated fullbody-geo (smplx?) shown so i guess its possible to visualize a whole body right? Thanks again ...

carlosedubarreto commented 3 years ago

That is odd. It works for me and I never opened this "o3d_scene.yml" file. I'm installing the now version to see what shows up.

FrankSpalteholz commented 3 years ago

Hi Carlos, just in case i wasn't precise enough. It is working with the skeleton-figure that doesn't contain hands (for this i don't have to edit the o3d_scene.yml att all). But my question is if its maybe possible to replace it with one of the female, male or neutral skinned/fullbody-figure. Thank you again for your lighting-speed-response!

carlosedubarreto commented 3 years ago

LOL I took 23 hour to answer 😅 It was not that fast....

I think understand now.... Easymocap runs using male figure, and you wanted do try female one? If that is the case, there is the female switch that you show do for that

like this: For male python apps/demo/mv1p.py 0_input/sample --out 0_input/sample/smplx --vis_det --vis_repro --undis --sub_vis 1 7 13 19 --body bodyhandface --model smplx --gender male --vis_smpl

for female: python apps/demo/mv1p.py 0_input/sample --out 0_input/sample/smplx --vis_det --vis_repro --undis --sub_vis 1 7 13 19 --body bodyhandface --model smplx --gender female --vis_smpl

ps.: this example is what I'm using in my computer

FrankSpalteholz commented 3 years ago

visualizer

No unfortunatly that's not what i've meant. The export itself/data-generation is working, although i'm still trying to figure out all the different flags. What i've meant is the 3D-real-time-visualizer where i can get only the hand-less-skeleton figure to run and i don't know how to change the o3d_scene.yml" file (like it was mentioned in the docs) to get another model to run (i'd be perfectly fine if the skeleton was "just" having hands and body) but in perfect-world i'd like to see the whole smplx/smplh-skinned-fullbody-figure hopping around. (and since i assume that you are working on this project in your freetime 24hours IS lighting-speed .. i sometimes waited 24 days in those cases)

carlosedubarreto commented 3 years ago

Ohhhhhhhh sorry.... Never used that 😅 Sorry for the confusion..

Yeah, cant help with that 😢.

Abut the lighting speed I understand it now LOL... I usually answer in the same day, yesterday was problematic, because I had to solve some issues outside home... (and yes, I try to help on this project at my spare time)

But well, I'll leave to see if @chingswy can help you, because I cant 😊

chingswy commented 3 years ago

body_type: "body25" <- bodyhand? (but its not working, i was checking config.py for this but i guess i made some mistakes)

Make sure that your results of keypoints3d have body+hand keypoints. I will add an example data for this visualization later.

FrankSpalteholz commented 3 years ago

nice! but replacing "body25" with "bodyhand" should work when the export was done right ... correct?

carlosedubarreto commented 3 years ago

nice! but replacing "body25" with "bodyhand" should work when the export was done right ... correct?

Yep, I think it will.

FrankSpalteholz commented 3 years ago

works like a charm .. thank you guys!

chingswy commented 3 years ago

Hello @FrankSpalteholz , I have updated this visualization part. Please check it.