search

YuelangX / Gaussian-Head-Avatar

[CVPR 2024] Official repository for "Gaussian Head Avatar: Ultra High-fidelity Head Avatar via Dynamic Gaussians"
Other
777 stars 49 forks source link

Export Gaussian Head as PLY file #33

Open sinbadthepoet opened 4 months ago

sinbadthepoet commented 4 months ago

Attempting to find the data for the Gaussian Head in a neutral pose to export into a PLY format, but I've only been able to find part of the data needed to export into a Gaussian Splat PLY format in the CameraModule file. Where might I find data such as the normals and sphere harmonics?

sinbadthepoet commented 4 months ago

I have managed to export the splats as PLYs using some code from the original 3DGS project, but an can't quite understand how to get the Spherical Harmonics exported. Reading it from the dictionary loaded in the reenactment file, it has 128 values per point in a linear array. To save it like the 3DGS project does, it requires a 3D Tensor of shape [Point Count, 3, (SH_Max + 1) ^ 2). Currently exporting these as zero tensors to get them into Unity, but any help would be appreciated!

YuelangX commented 4 months ago

I'm afraid exporting Spherical Harmonics is not supported, because the model directly outputs RGB color.

1997MarsRover commented 3 months ago

hello @sinbadthepoet .. May i ask how you managed to export the ply file of the gaussian head and what the results looked like. Thanks