fraunhoferhhi / gaussian_gan_decoder

[CVPRW '24] Turning the output of NeRF based 3D GANs into 3DGS scenes in a single forward pass.
https://florian-barthel.github.io/gaussian_decoder/index.html
60 stars 3 forks source link

Train my own gausssians #13

Open starlordlxt opened 3 months ago

starlordlxt commented 3 months ago

Hi! I am using Panohead to generate my own avatar and want to use the decoder you provided to convert it into a 3DGS model. I have generated a fintuned_generator.pkl file and a projected_w.npz file using Panohead. I trained the decoder with fintuned_generator.pkl using the code you provided, but how should I use the projected_w.npz to generate the desired portrait? I noticed that in your work, this aspect wasn't covered, and the "z" is mostly randomly generated. Thank you very much, and kudos to your work!

windlikestone commented 1 month ago

Hi, have you been able to solve this problem? I also want to know how to inverse my own image into the Gaussian representation.