gafniguy / 4D-Facial-Avatars

Dynamic Neural Radiance Fields for Monocular 4D Facial Avater Reconstruction
679 stars 67 forks source link

How to Render (eval_transformed_rays.py) with Ablation? #36

Closed joiellantero closed 2 years ago

joiellantero commented 2 years ago

I was able to train person3 dataset but when I tried to run eval_transformed_rays.py, the output is just a still video. I'm trying to set the angle of the head to face the camera and to keep the expressions. Any suggestions on a solution that I can try?

I tried to do the following:

Did I miss anything? Also, what should be the correct value for index_of_image_after_train_shuffle?

Thanks!

joiellantero commented 2 years ago

If I set no_lcode = True, I keep getting an index error.

latent_code = latent_codes[index_of_image_after_train_shuffle].to(device) if use_latent_code else None
IndexError: index 1150 is out of bounds for dimension 0 with size 100
joiellantero commented 2 years ago

Solved this by setting these to False

  no_background = False
  no_expressions = False
  no_lcode = False
  nerf = False
  frontalize = False
  interpolate_mouth = False