gafniguy / 4D-Facial-Avatars

Dynamic Neural Radiance Fields for Monocular 4D Facial Avater Reconstruction
670 stars 67 forks source link

Validation and testing results are not good #18

Open chienyiwang opened 2 years ago

chienyiwang commented 2 years ago

Hi, Thanks for the great work and kind release of the implementation. I followed the modification in Issue#16 and could train the model with your default .yml file. However, the validation and testing results are not good visually (using ckpt at epoch 500k/600k/...). Most of them are blurry and some of them even only contains background. The training losses are decreasing, but the coarse loss of validation set is not. Could you please provide some suggestions about how to tune the parameters or fix the model training? Thanks a lot!

The validation results and loss curves from tensorboard snapshots are attached below: test_result train_loss

chienyiwang commented 2 years ago

I accidentally set "no_ndc" to "False" in the previous experiments... After setting back "no_ndc" to "True", the results are getting much better now. result loss

chienyiwang commented 2 years ago

If possible, could you elaborate more on the choice of "no_ndc"? Is it heavily dependent on the input format or just empirical? Thanks a lot!

cjerry1243 commented 2 years ago

I am not able to get the results with the same quality as the paper either.

Alpe6825 commented 1 year ago

I accidentally set "no_ndc" to "False" in the previous experiments... After setting back "no_ndc" to "True", the results are getting much better now. result loss

I get similar results even if no_ndc is true.

jianweif commented 1 year ago

Same here. Trained with person_1's data and config. Training psnr gradually reaches 32 while validation psnr plateaus at 20. Would really appreciate if author can help here!

Volleria commented 1 year ago

Hi, Thanks for the great work and kind release of the implementation. I followed the modification in Issue#16 and could train the model with your default .yml file. However, the validation and testing results are not good visually (using ckpt at epoch 500k/600k/...). Most of them are blurry and some of them even only contains background. The training losses are decreasing, but the coarse loss of validation set is not. Could you please provide some suggestions about how to tune the parameters or fix the model training? Thanks a lot!

The validation results and loss curves from tensorboard snapshots are attached below: test_result train_loss

Hi!How did you get these charts?

wuzuyin commented 8 months ago

Same here. Trained with person_1's data and config. Training psnr gradually reaches 32 while validation psnr plateaus at 20. Would really appreciate if author can help here!

Hello, I have also encountered the same problem. Have you resolved it