MrTornado24 / Next3D

[CVPR 2023 Highlight] Next3D: Generative Neural Texture Rasterization for 3D-Aware Head Avatars
https://mrtornado24.github.io/Next3D/
470 stars 29 forks source link

Unable to slove portrait inversion problem due to not converge. #27

Closed SCZwangxiao closed 1 year ago

SCZwangxiao commented 1 year ago

I've modified the code in PTI to solve the portrait inversion problem. But the model is unable to converge. Are there any tricks or modifications that I've missed?

MrTornado24 commented 1 year ago

The PTI we used is similar to eg3d-pti. Do you able to converge on eg3d? BTW, I'll clean the inversion code and release it soon.

SCZwangxiao commented 1 year ago

Problem solved. The failure is due to using old camera data in {indir}/crop/cameras.json, instead of the results produced by preprocess_face_cameras.py, where the intrinsics are calibrated.

SCZwangxiao commented 1 year ago

The PTI we used is similar to eg3d-pti. Do you able to converge on eg3d? BTW, I'll clean the inversion code and release it soon.

Once again, I extend my gratitude to the author for their generous assistance.