search

benjiebob / SMALify

This repository contains an implementation for performing 3D animal (quadruped) reconstruction from a monocular image or video. The system adapts the pose (limb positions) and shape (animal type/height/weight) parameters for the SMAL deformable quadruped model, as well as camera parameters until the projected SMAL model aligns with 2D keypoints and silhouette segmentations extracted from the input frame(s).
106 stars 18 forks source link

how to train the Quadruped Joint Predictor #12

Closed buaaswf closed 3 years ago

buaaswf commented 3 years ago

Hi @benjiebob , I try to apply this to other Quadruped animals, could you please show me the details about how to train the Quadruped Joint Predictor? Thanks

yours Wenfeng

benjiebob commented 3 years ago

Automatic prediction of quadruped joints is not yet included in this library. The basic idea is to create a synthetic set of SMAL quadruped models and train hourglass network to predict the joints.

A similar idea (that relies on few keypoint annotations) is available here SMALST and shown on zebra.

benjiebob commented 3 years ago

Going to close for now.