johndpope / MegaPortrait-hack

Using Claude Opus to reverse engineer code from MegaPortraits: One-shot Megapixel Neural Head Avatars
https://arxiv.org/abs/2207.07621
82 stars 8 forks source link

One-Shot_Free-View -supplemental #9

Closed johndpope closed 6 months ago

johndpope commented 6 months ago

https://openaccess.thecvf.com/content/CVPR2021/supplemental/Wang_One-Shot_Free-View_Neural_CVPR_2021_supplemental.pdf

when I dig into where the keypoints live , we utilize a similar volumetric encoding of the appearance but instead encode the face motion implicitly, which improves cross-reenactment performance.

can rip out face_alignment from emodataset.