search

johndpope / MegaPortrait-hack

Using Claude Opus to reverse engineer code from MegaPortraits: One-shot Megapixel Neural Head Avatars
https://arxiv.org/abs/2207.07621
77 stars 8 forks source link

Training on CelebV-HQ #56

Open kuwan2e opened 2 months ago

kuwan2e commented 2 months ago

data downloaded from torrent. use data/celebvhq_info.json. when training some of the videos go well. some of them raise this error: when training

raise TypeError(f"pic should be Tensor or ndarray. Got {type(pic)}.")

TypeError: pic should be Tensor or ndarray. Got <class 'NoneType'>.
johndpope commented 2 months ago

there's more than 1 thing wrong with this codebase - that i need to circle back and fix i solved some things here https://github.com/johndpope/IMF/blob/main/WebVid10M.py#L56 this has special locking code to prevent threads endlessly spawning...

the other thing is identity leakage - i think there's some batch operation that's mixing values up -

we have this upstream implementation now from original author of paper https://github.com/neeek2303/EMOPortraits