search

alvinliu0 / HumanGaussian

[CVPR 2024 Highlight] Code for "HumanGaussian: Text-Driven 3D Human Generation with Gaussian Splatting"
https://alvinliu0.github.io/projects/HumanGaussian
MIT License
439 stars 45 forks source link

The problem of view dependent prompt #5

Open DSaurus opened 12 months ago

DSaurus commented 12 months ago

It appears that the SMPLX coordinate system is not aligned with the threestudio coordinate system, resulting in incorrect view-dependent prompts during generation. For instance, an azimuth angle of around -180 should represent a side view, but it currently also corresponds to a back view.

problem view

alvinliu0 commented 11 months ago

Hi:

Many thanks for pointing out this problem! I guess there could be some camera coordinate-related issues. Currently, it's OK since we have the per-view body skeleton as an input condition, so the generation correctness is guaranteed by structural guidance (i.e., even if we give a wrong view-dependent prompt of back-view, the skeleton can tell the model it's actually a side-view).

Thanks again for notifying this and we will update it in later commits:)

Best

y6216886 commented 11 months ago

@alvinliu0 Hello, have you updated this issue, I also came across this issue, resulting in one human face in the front view and one human face in the back view.

XiaokunSun commented 9 months ago

@alvinliu0 Hello, have you updated this issue, I also came across this issue, resulting in one human face in the front view and one human face in the back view.

Hi, the bugs don't seem to be fixed!