lizhe00 / AnimatableGaussians

Code of [CVPR 2024] "Animatable Gaussians: Learning Pose-dependent Gaussian Maps for High-fidelity Human Avatar Modeling"
https://animatable-gaussians.github.io/
Other
896 stars 59 forks source link

Rendered results not meeting expectation on training set #12

Open 475651582 opened 6 months ago

475651582 commented 6 months ago

It is really a fantastic work. Congrats! I managed to deal with all the data preprocessing and testing. However I found the rendered results on avatar_lbn1 is not quite ideal, even on the training smpl dataset. The rendered image rendered below ith command [python main_avatar.py -c configs/avatarrex_lbn1/avatar.yaml --mode=test]: image image Is that sounds reasonable to you? Thanks very much!

lizhe00 commented 6 months ago

Could you attach your yaml file?

lizhe00 commented 6 months ago

And which frame?

475651582 commented 6 months ago

frame id is 00001080 avatar.txt

lizhe00 commented 6 months ago

My result seems to be correct. Do you download our preprocessed files (https://github.com/lizhe00/AnimatableGaussians/blob/master/PREPROCESSED_DATASET.md)?

00001080

475651582 commented 6 months ago

My result seems to be correct. Do you download our preprocessed files (https://github.com/lizhe00/AnimatableGaussians/blob/master/PREPROCESSED_DATASET.md)?

00001080

yes, here is the dataset structure preview: image

lizhe00 commented 6 months ago

What about other frames?

475651582 commented 6 months ago

What about other frames?

mostly faild. most of the faces looks strange like they are stitched to the head. image

I only tried your released pretrained model. Do I have to train from scratch?

475651582 commented 6 months ago

Note that I mosaic the face for the sake of privacy :)

lizhe00 commented 6 months ago

Thanks for protecting the privacy. Sorry, I don't know the reason. The results I just ran are correct. Maybe you can check if some codes are changed or train from scratch.

475651582 commented 6 months ago

Thanks for protecting the privacy. Sorry, I don't know the reason. The results I just ran are correct. Maybe you can check if some codes are changed or train from scratch.

Thanks, I will review that. BTW, there is an extra information I need to confirm. For SMPL-X model, Did you use 10-shape version or 300-shape version?

lizhe00 commented 6 months ago

10-shape version.

trThanhnguyen commented 4 months ago

Hi, @475651582. Thanks for raising the issue. Could you please describe how you managed to get the 'smpl_params.npz' for the subject? Many thanks.