Using other multi view models?

TencentARC / InstantMesh

InstantMesh: Efficient 3D Mesh Generation from a Single Image with Sparse-view Large Reconstruction Models

Apache License 2.0

2.75k stars 269 forks source link

Using other multi view models? #108

Open LucioC opened 1 month ago

LucioC commented 1 month ago

I really liked the overall results compared to other open source solutions I saw. But for some images I tested it really seems the zero123++ views are bad, compared to other options (such as sv3d).

So I wanna confirm in a high level how the integration can be done. Does you solution requires a specific quantity of images in specific angles? Or can we use the 21 frames sv3d generates?

bluestyle97 commented 1 month ago

Our sparse-view large recconstruction model was trained using free-viewpoint images, thus it can be integrated with arbitrary multiview diffusion model in theory.