johndpope / MegaPortrait-hack

Using Claude Opus to reverse engineer code from MegaPortraits: One-shot Megapixel Neural Head Avatars
https://arxiv.org/abs/2207.07621
82 stars 8 forks source link

Stage 1 - apply_warping_field - vs seems to be wrong size #12

Closed johndpope closed 6 months ago

johndpope commented 6 months ago

vs shape: torch.Size([1, 96, 16, 32, 32]) should be [1, 96, 16, 64, 64]

@kwentar - Aleksey I add the extra ResBlock3d_96

https://github.com/johndpope/MegaPortrait-hack/commit/d8505b0d509228727279c5d6dcf005197478982d

I think there's something wrong with the avgpool

TODO - inspect any deviation in the ResBlock_Custom vs ResBlock3D_Adaptive / there totally built separately....

johndpope commented 6 months ago

for now I rip out one of the avgpool layers - then we get to 64x64 - otherwise its 32x32. on to g2d

johndpope commented 6 months ago

G2d is ok - but have to fix eyeglaze loss