johndpope / MegaPortrait-hack

Using Claude Opus to reverse engineer code from MegaPortraits: One-shot Megapixel Neural Head Avatars
https://arxiv.org/abs/2207.07621
68 stars 7 forks source link

One-Shot_Free-View -supplemental #9

Closed johndpope closed 4 months ago

johndpope commented 4 months ago

https://openaccess.thecvf.com/content/CVPR2021/supplemental/Wang_One-Shot_Free-View_Neural_CVPR_2021_supplemental.pdf

when I dig into where the keypoints live , we utilize a similar volumetric encoding of the appearance but instead encode the face motion implicitly, which improves cross-reenactment performance.

can rip out face_alignment from emodataset.