MarilynKeller / OSSO

From a body shape, infer the anatomic skeleton.
Other
210 stars 32 forks source link

Where to get more demo body? #14

Closed qaz8788817 closed 6 months ago

qaz8788817 commented 6 months ago

Hi, this is a truly impressive piece of work. I'd like to try out more models. Could you please let me know where I can find similar human body models for experimentation, like those in the demo folder?

Thank you.

MarilynKeller commented 6 months ago

Hi, you can find a large variety of SMPL bodies and sequences in the AMASS Dataset

In the download section, click on SMPL+H G

image

To vizualize those sequences of bodies in motion, you can use AitViewer.

Please also note that OSSO is a project from 2022, we now have a new body+skeleton model called SKEL that supports more applications: https://skel.is.tue.mpg.de/.

qaz8788817 commented 6 months ago

Hi, you can find a large variety of SMPL bodies and sequences in the AMASS Dataset

In the download section, click on SMPL+H G image

To vizualize those sequences of bodies in motion, you can use AitViewer.

Please also note that OSSO is a project from 2022, we now have a new body+skeleton model called SKEL that supports more applications: https://skel.is.tue.mpg.de/.

Hi, thanks for your reply. After I downloaded and decompressed one of the AMASS dataset, I got multiple sets of npz files. Should I use osso/utils/fit_osso.py to convert these files into ply files? Or there is a mistake in my understanding.

Thank you.

qaz8788817 commented 6 months ago

I'm not sure if it's appropriate to ask this question, and I apologize if it causes any inconvenience. I followed the instruction to download the CMU dataset from AMASS, and after extracting it, I obtained npz files containing different actions from various subjects. I used numpy to read one of the files, and the contents are as follows: image Here is no vertices and faces in these files. I would like to convert these files into ply or obj format so that I can use main.py to generate skeletons. Is there any method to convert these npz files into obj or ply files? Thank you.

MarilynKeller commented 6 months ago

The AMASS files contain sequences of parameters defining for each frame the pose (poses), body shape (betas) and translation (trans) of a human body. To generate a 3D mesh out of them, you need to use SMPL. You can use it through the smplx library (https://github.com/vchoutas/smplx).

You can see an example of how we get the SMPL mesh vertices from the .npz dictionary here

Note that In your more recent project SKEL, we have a demo where we directly fit the SKEL skeleton model to an AMASS sequence.

qaz8788817 commented 6 months ago

The AMASS files contain sequences of parameters defining for each frame the pose (poses), body shape (betas) and translation (trans) of a human body. To generate a 3D mesh out of them, you need to use SMPL. You can use it through the smplx library (https://github.com/vchoutas/smplx).

You can see an example of how we get the SMPL mesh vertices from the .npz dictionary here

Note that In your more recent project SKEL, we have a demo where we directly fit the SKEL skeleton model to an AMASS sequence.

Thanks. I follow the SKEL installation steps to install aitviewer, and I cannot install it successfully. I have commented my error and question here: https://github.com/MarilynKeller/aitviewer-skel/issues/2#issuecomment-1972391757

Thanks.