benjiebob / SMALify

This repository contains an implementation for performing 3D animal (quadruped) reconstruction from a monocular image or video. The system adapts the pose (limb positions) and shape (animal type/height/weight) parameters for the SMAL deformable quadruped model, as well as camera parameters until the projected SMAL model aligns with 2D keypoints and silhouette segmentations extracted from the input frame(s).
110 stars 18 forks source link

when will you provide dog keypoint prediction code #20

Closed sunbin1357 closed 3 years ago

sunbin1357 commented 3 years ago

when will you provide dog keypoint prediction code

benjiebob commented 3 years ago

Unfortunately, releasing specific code for our paper Creatures Great and SMAL is nontrivial due to terms in my PhD sponsorship. This is something I will look at doing, but this is not my current priority (my thesis is due soon!).

However, if you are just in need of a trained dog keypoint predictor, you can train (for example) HourglassNet on the StanfordExtra dataset. We are planning to release a pretrained model for this soon -- tagging @OllieBoyne for his awareness on this.

sunbin1357 commented 3 years ago

I haven't looked at StanfordExtra dataset yet. Is it in the same format as Human3.6m or COCO?