johndpope / MegaPortrait-hack

Using Claude Opus to reverse engineer code from MegaPortraits: One-shot Megapixel Neural Head Avatars
https://arxiv.org/abs/2207.07621
68 stars 7 forks source link

README #7

Closed tanshuai0219 closed 4 months ago

tanshuai0219 commented 4 months ago

Hi, thanks for your clear open-source codes. Could you write a "README.md" for using these codes?

johndpope commented 4 months ago

I'm kinda bricked getting the entire thing to cycle through -

to be upfront - this worked is predominantly just spat out by Claude Opus https://github.com/johndpope/MegaPortrait-hack/blob/main/model.py

i ask Claude to align the paper +code - i iterate - sometimes ditch the context and build out the models. related https://github.com/Kevinfringe/MegaPortrait/issues/5

been stuck on just this model and how it should exactly conform to code.

Screenshot 2024-05-16 at 8 30 07 pm

there's a couple of mp4s in junk folder that should load when you python train.py

johndpope commented 4 months ago

i add some notes - I focus on creating issues that need to get resolved before this will work.