alex-moon / vc

MIT License
22 stars 6 forks source link

Optimise inpainting and vqganclip #39

Closed alex-moon closed 2 years ago

alex-moon commented 3 years ago

First swap the order. Try it and see - doing inpainting second means you get artefacts of the 3d transform. Meanwhile we might even be able to get rid of inpainting entirely this way as vqganclip will fill in the occlusions to some extent. Try it and see.

Second, try this: instead of doing inpainting then vqganclip every frame, do inpainting once, then move the same mesh until total translation sums to 3 or more, then trigger both inpainting and vqganclip and repeat.