search

reyuwei / NIMBLE_model

repo for NIMBLE: A Non-rigid Hand Model with Bones and Muscles
https://liyuwei.cc/proj/nimble
MIT License
115 stars 17 forks source link

How to generate a dataset using this model？ #4

Closed Greyman-Seu closed 1 year ago

Greyman-Seu commented 1 year ago

This is very wonderful work. NIMBLE model provides diffuse,spec ,mesh,etc. But pytorch3d only needs vert, face, texture map to build mesh. How to use this model to generate synthetic picture.Can you give some examples？

reyuwei commented 1 year ago

Hi! I use blender to render synthetic images shown in the paper. I have uploaded the project file with shading and background in google drive link. Please follow thefollowing steps in the readme file for rendering. Thanks!

Render in assets/render.blend Scale down the meshes and manually assign texture images. Select non-color for color space of normal and specular textures.

gs-ren commented 1 year ago

Thank you for the method. How can I get the correct m v p matrix while use Blender to create a synthetic picture? I found that the 2D label value（from .xyz files） cannot be calculated correctly in the synthetic picture. Can you share your method please? @reyuwei

reyuwei commented 1 year ago

Thank you for the method. How can I get the correct m v p matrix while use Blender to create a synthetic picture? I found that the 2D label value（from .xyz files） cannot be calculated correctly in the synthetic picture. Can you share your method please? @reyuwei

You can export both intrinsic and extrinsic camera matrix from Blender, then project 3D joints to image. I have attached an old script for exporting camera parameters from Blender for reference. Not sure if it works with the latest Blender version.

export_camera_from_blender.py