search

sergeyprokudin / smplpix

SMPLpix: Neural Avatars from 3D Human Models
425 stars 63 forks source link

Get 3d textured model #19

Closed kashyappiyush1998 closed 2 years ago

kashyappiyush1998 commented 2 years ago

How do I get the corresponding SMPL textured model for my video with vertex color or UV map for my video input? As in #16 smplx_verts_colors.txt and the output from where do I get those

sergeyprokudin commented 2 years ago

Hi @kashyappiyush1998 ,

you can find the vertex colours here.

Hope it helps, ~Sergey

kashyappiyush1998 commented 2 years ago

This is a constant txt file, right? Is there a way to get vertex colors and SMPL model generated from video? Thanks

sergeyprokudin commented 2 years ago

you can get the SMPL-x model params (via SMPlify-x framework), but the appearance information itself is generated via the trained rendering network, not stored explicitly.

kashyappiyush1998 commented 2 years ago

Thanks, I will try on your repo for [smplify-x]. I just had one more question,is there to achieve this using newer method like EXPOSE, which have better performance when it comes to time. I have tried Smplpix and it works using https://github.com/vchoutas/expose , however colour will be a issue there. Is there a general method to generate color.

sergeyprokudin commented 2 years ago

sure, you can try regression-based methods like expose or more recent works (e.g. PARE or PIXIE), but optimisation-based methods give better alignment of 3D mesh and observed body keypoints, which simplifies rendering training step.

For inferring uv maps directly, check this issue. Short version: try Densepose or Texformer.