search

benjiebob / SMALify

This repository contains an implementation for performing 3D animal (quadruped) reconstruction from a monocular image or video. The system adapts the pose (limb positions) and shape (animal type/height/weight) parameters for the SMAL deformable quadruped model, as well as camera parameters until the projected SMAL model aligns with 2D keypoints and silhouette segmentations extracted from the input frame(s).
MIT License
120 stars 18 forks source link

For another animal species #16

Closed EAST-J closed 3 years ago

EAST-J commented 4 years ago

Hi Ben,

Thanks a lot for your great work. I would like to know what should I do if I want to use SMALify to another species(like horse). I see the SHAPE_FAMILY in config.py. I wonder anything else should I do?

benjiebob commented 4 years ago

This should be everything you need to do! You'll need to edit your dataloader to load a horse sequence which has annotated 2D joints + segmentations but then it should work. Let me know how you get on, I'm grateful to have someone test this!

EAST-J commented 4 years ago

Thanks, I would like to try in couple of days. Besides I see some other species annotations in data/BADJA/joint_annotations, I wonder there is images and segmentations?

EAST-J commented 4 years ago

And I wonder is there any requirement for the size of the image

Autumnfall-Me commented 4 years ago

hey ben, Thanks a lot for your great work. I would like to build my new SMAL model such as pig. Now I have .OBJ 3D models, and have ran fitter_3d/optimise.py. Then I got the npz file. If I save them as a pkl file, is it a SMAL model? I'm very confused. I would like to know what I should do next.

benjiebob commented 3 years ago

BADJA does contain images + segs. I don't believe there is a requirement for the image size but let me know in a separate issue if you find problems for this. @Autumnfall-Me - your question seems a duplicate of https://github.com/benjiebob/SMALify/issues/18.

Closing this issue for now, as I believe running the code on another SMAL animal category is working. Please reopen if you do find issues.