search

benjiebob / SMALify

This repository contains an implementation for performing 3D animal (quadruped) reconstruction from a monocular image or video. The system adapts the pose (limb positions) and shape (animal type/height/weight) parameters for the SMAL deformable quadruped model, as well as camera parameters until the projected SMAL model aligns with 2D keypoints and silhouette segmentations extracted from the input frame(s).
MIT License
120 stars 18 forks source link

fine-tune 3D smal fiting #31

Open bobby20180331 opened 1 year ago

bobby20180331 commented 1 year ago

Hi, @benjiebob ,thanks for your sharing. I have tried to utilize the project to get a fine-tune smal parameters for a specific cat with a cat .obj file. And the smal results as followed. 1.family_0.obj fine-turn to family 0 smal base model stage 0 result 00781_family_0 - Stage0

2.family_0.obj fine-turn to family 0 smal base model stage 2 result 00781_family_0 - Stage2

3.family_4.obj fine-turn to family 0 smal base model stage 0 result

00781_family_4 - Stage0

4.family_4.obj fine-turn to family 0 smal base model stage 2 result 00781_family_4 - Stage2

Seems that it can work better for cross species other in the same species with minor difference. Any suggestion for a better inner-species fine-turn result? We may Take the family_0.obj exported from data_000781_4_all.pkl as a benchmark.

Configaration for the result above: My training config use the fitter_3d/example_cfg.yaml (family_id=0) and my input .obj was exported from my_smpl_data_00781_4_all.pkl.

yichuan1998 commented 1 year ago

Hi, @benjiebob ,thanks for your sharing. I have tried to utilize the project to get a fine-tune smal parameters for a specific cat with a cat .obj file. And the smal results as followed. 1.family_0.obj fine-turn to family 0 smal base model stage 0 result 00781_family_0 - Stage0

2.family_0.obj fine-turn to family 0 smal base model stage 2 result 00781_family_0 - Stage2

3.family_4.obj fine-turn to family 0 smal base model stage 0 result

00781_family_4 - Stage0

4.family_4.obj fine-turn to family 0 smal base model stage 2 result 00781_family_4 - Stage2

Seems that it can work better for cross species other in the same species with minor difference. Any suggestion for a better inner-species fine-turn result? We may Take the family_0.obj exported from data_000781_4_all.pkl as a benchmark.

Configaration for the result above: My training config use the fitter_3d/example_cfg.yaml (family_id=0) and my input .obj was exported from my_smpl_data_00781_4_all.pkl.

Hi, have you figured out this problem?