search

skywolf829 / GSTK

Gaussian Splatting toolkit application. One stop shop for preprocessing your dataset, training your model with human-in-the-loop training, and editing saved GSplat PLY files.
MIT License
4 stars 1 forks source link

Generative model training (Dream) #16

Closed skywolf829 closed 6 months ago

skywolf829 commented 7 months ago

DreamFustion by Poole et al. and DreamGaussian by Tang et al. are two methods that enable a Text-to-3D model. This issue is to support training a GS model like this, from either a text string or a single image.

Include other packages as needed, since some NLP/LLM may be necessary, as well as other metrics like CLIP. Adjust the GaussianModel, Trainer, and Dataset objects as necessary to fit the standard GS training as well as "dream" training.

skywolf829 commented 6 months ago

Closing to move to backend repo.