facebookresearch / banmo

BANMo Building Animatable 3D Neural Models from Many Casual Videos
Other
531 stars 59 forks source link

Visualize of articulated shape #46

Open Lxiangyue opened 1 year ago

Lxiangyue commented 1 year ago

Many thanks for your great job!

Could you tell me how to generate dynamic 3d models like the "Articulated shape:" of cat-pikachiu on this page?

gengshan-y commented 1 year ago

Hi, the idea is to use banmo's forward skinning weights (NxB matrix) to animate the rest mesh (Nx3 points) given control points transformations over time (Tx6).

We use the gltf convention (here's a tutorial) to store the animated mesh, and use model-viewer to render it on a web brower. The challenging part is converting between banmo's format and gltf, which is still under development.