facebookresearch / banmo

BANMo Building Animatable 3D Neural Models from Many Casual Videos
Other
539 stars 58 forks source link

Visualize of articulated shape #46

Open Lxiangyue opened 2 years ago

Lxiangyue commented 2 years ago

Many thanks for your great job!

Could you tell me how to generate dynamic 3d models like the "Articulated shape:" of cat-pikachiu on this page?

gengshan-y commented 2 years ago

Hi, the idea is to use banmo's forward skinning weights (NxB matrix) to animate the rest mesh (Nx3 points) given control points transformations over time (Tx6).

We use the gltf convention (here's a tutorial) to store the animated mesh, and use model-viewer to render it on a web brower. The challenging part is converting between banmo's format and gltf, which is still under development.