search

johndpope / MegaPortrait-hack

Using Claude Opus to reverse engineer code from MegaPortraits: One-shot Megapixel Neural Head Avatars
https://arxiv.org/abs/2207.07621
82 stars 8 forks source link

preprocessing steps - warp / crop / align / mask #34

Closed johndpope closed 5 months ago

johndpope commented 5 months ago

Screenshot from 2024-06-02 19-08-57 masked_target_image_0

this is a bit of a mess. masks are completely off.

johndpope commented 5 months ago

Screenshot from 2024-06-03 06-03-46

i add some code to remove background - and save out videos. the amount of effort to clean up videos is quite steep - will be a blessing when EmoPortraits drops new video dataset.

johndpope commented 5 months ago

i make some call to just crop every video frame to head - then resize back to 512. I add a flag. - i think this makes most sense - as they say they do crop / warp - and they're training resolution is 256x256 and 512 x512

000009 i rip out background too.