search

WU-CVGL / MVControl

[3DV-2025] Official implementation of "Controllable Text-to-3D Generation via Surface-Aligned Gaussian Splatting"
https://lizhiqi49.github.io/MVControl/
MIT License
191 stars 6 forks source link

Question about optimizing the own mesh. #13

Open yiboz2001 opened 3 months ago

yiboz2001 commented 3 months ago

Hi, thanks for the open-sourced project! I try to use my own mesh (without texture) as the initialization of stage 3 and hope to optimize the corresponding SuGaR using default vsd loss, but the texture of final result seems bad

7

For the loss term, I only use the "2d" guidance.

        out_2d = self.training_substep(batch, batch_idx, guidance="2d")
        total_loss += out_2d["loss"]
        # if self.guidance_control is not None and self.C(self.cfg.loss.lambda_sds_control) > 0:
        #     out_mvcontrol = self.training_substep(batch, batch_idx, guidance="mvcontrol")
        #     total_loss += out_mvcontrol["loss"]
        # out_ref = self.training_substep(batch, batch_idx, guidance="ref")
        # total_loss += out_ref["loss"]

I will highly appreciate it if you have any suggestion for improving the result.