How to init Magic 3D refine with a custom mesh?

threestudio-project / threestudio

A unified framework for 3D content generation.

Apache License 2.0

6.19k stars 474 forks source link

How to init Magic 3D refine with a custom mesh? #79

Open canxkoz opened 1 year ago

canxkoz commented 1 year ago

Hello I am trying to refine a Mesh that I already have using the refinement stage of Magic3D. I am getting dimension errors. Could you please help me? My fork: https://github.com/canxkoz/threestudio/blob/main/threestudio/systems/magic3d.py

bennyguo commented 1 year ago

Hi! I believe ShapeLoss is only suited for constraining a density field to a guide mesh, while the refinement stage of Magic3D has an SDF representation. To refine a guide mesh, you could (1) first use Fantasia3D to refine the geometry (currently only support sphere and ellipsoid initialization, but I'll push an update to support initialization from a given mesh tomorrow) (2) keep the mesh fixed and texture it using SDS/VSD (will support this texturing feature in a few days)