nr-reg

Repo for non-rigid registration method used in PIANO: A Parametric Hand Bone Model from Magnetic Resonance Imaging, IJCAI' 21 and NIMBLE: A Non-rigid Hand Model with Bones and Muscles, SIG' 22

Main requirements

• gdist
• Pytorch
• Pytorch3d
• Trimesh (with pyembree)

Getting Started

• Embedded non-rigid registration (PIANO)

  • reg_embedded.py

• Tetrahedral-based non-rigid deformation (NIMBLE)

  • reg_tet.py
  • Note that the template mesh should be a tetrahedral mesh, generated by tetgen. Use readtetfile to parse tetgen output and save to a pkl file. (template_rest_tet in param_tet.yml)

References

• Algorithm reference

  • [TOG20] Constraining Dense Hand Surface Tracking with Elasticity
  • [SIG12 Course] FEM Simulation of 3D Deformable Solids: A practitioner's guide to theory, discretization and model reduction
  • [TVCG19] FlyFusion: Realtime Dynamic Scene Reconstruction Using a Flying Depth Camera
  • [SIG18] MonoPerfCap: Human Performance Capture from Monocular Video
  • [SIG07] Embedded Deformation for Shape Manipulation

• Code reference

  • manopth and obman_train by Yana Hasson
  • pytorch_HMR by Zhang Xiong
  • SMPLX by Vassilis Choutas
  • LoopReg by Bharat Bhatnagar
  • GAMES201-elasticity demo by Yuanming Hu