Using other multi view models?

TencentARC / InstantMesh

InstantMesh: Efficient 3D Mesh Generation from a Single Image with Sparse-view Large Reconstruction Models

Apache License 2.0

3.41k stars 368 forks source link

Using other multi view models? #108

Closed LucioC closed 4 months ago

LucioC commented 5 months ago

I really liked the overall results compared to other open source solutions I saw. But for some images I tested it really seems the zero123++ views are bad, compared to other options (such as sv3d).

So I wanna confirm in a high level how the integration can be done. Does you solution requires a specific quantity of images in specific angles? Or can we use the 21 frames sv3d generates?

bluestyle97 commented 5 months ago

Our sparse-view large recconstruction model was trained using free-viewpoint images, thus it can be integrated with arbitrary multiview diffusion model in theory.