facebookresearch / banmo

BANMo Building Animatable 3D Neural Models from Many Casual Videos
Other
539 stars 58 forks source link

can banmo be used for 3D reconstruction of birds? #56

Closed litchisea closed 1 year ago

litchisea commented 1 year ago

Thank you for your fascinating work! Birds are neither human nor four-legged, is it possible to have a bird Pre-trained PoseNet weights, or can the PoseNet weights trained for quadrupeds be modified for 3D reconstruction of birds?

gengshan-y commented 1 year ago

Hi, unfortunately, we don't have a pre-trained PoseNet for birds, but it would be possible to hook up banmo with pre-trained models of CMR, which learns birds' pose from images.

litchisea commented 1 year ago

Thank you so much! Can the pre-trained model of Eagle on simulated data be used for Eagle on real data? If yes, can you provide the pre-trained model of Eagle?

gengshan-y commented 1 year ago

Hi, the pre-trained weights only store the shape and pose of a deformation 3D object, and cannot be used to infer pose/shape from images. To do so, one solution is to further train a feedforward network given those weights (e.g., in our recent work dasr)

litchisea commented 1 year ago

Thank you very much!