search

threestudio-project / threestudio

A unified framework for 3D content generation.
Apache License 2.0
6.34k stars 480 forks source link

Implementation of Score Distillation via Inversion #508

Open ottogin opened 2 weeks ago

ottogin commented 2 weeks ago

Here is implementation of our paper on analyzing Score Distillation by viewing it as re-parametrization of DDIM, what suggests that the noise sample should be carefully chosen in SDS. In the PR we implement an improved method called SDI where the noise term is regressed via inverting DDIM.

The paper is accepted to NeurIPS 2024. ArXiv: https://arxiv.org/abs/2405.15891 Webpage: https://lukoianov.com/sdi

The pull request contains implementation of SDI as a module in threestudio and an additional notebook with 2D optimization using different strategies of noise term sampling.

thuliu-yt16 commented 1 week ago

Appreciate your contribution, nice work! Looks good to me except for some redundant files.

ottogin commented 1 week ago

Good catch, and thank you for reviewing it so fast. Removed the extra files