search

TencentARC / InstantMesh

InstantMesh: Efficient 3D Mesh Generation from a Single Image with Sparse-view Large Reconstruction Models
Apache License 2.0
3.3k stars 352 forks source link

Align the generated mesh with Zero123++'s coordinate system #134

Open YZsZY opened 3 months ago

YZsZY commented 3 months ago

Hi author, I rendered the mesh output from InstantMesh using the 6 viewpoints from zero123++ output, but it seems to be not aligned on the scale. ScreenCapture_2024-08-05-14-15-46 2_rmbg This is the view capture from the azimuth(0), elevation(30), scale = 4, which is the input view angle in Zero123++, but when I use the same camera params to render the generated mesh, the scale seems to different, how to solve this problem? image

Dumeowmeow commented 1 month ago

Hi author, I rendered the mesh output from InstantMesh using the 6 viewpoints from zero123++ output, but it seems to be not aligned on the scale. ScreenCapture_2024-08-05-14-15-46 2_rmbg This is the view capture from the azimuth(0), elevation(30), scale = 4, which is the input view angle in Zero123++, but when I use the same camera params to render the generated mesh, the scale seems to different, how to solve this problem? image

Hello!Did you render directly with the resulting mesh, rather than through the three planes in the paper? If so, can you share the code?Thank you~

JennySeidenschwarz commented 1 month ago

From where did you find that elevation 30deg is the input elevation of zero123++? I would have somehow assumed its 0deg since we are using elevations = np.array([20, -10, 20, -10, 20, -10]) as elevations and the elevation is relative to the input image.