Retrain on Face

[pureexe]

What's the problem

We used to have the version that trained of FFHQ and can control Left-Right direction Right now we add the inversion code to the detail. With the inversion code, we have problem that we cannot control the lighting.

1. Train the new code on FFHQ to see if it can do the left-right (without inversion) first. if positive: we at the same point of previous model that can have 99% accuracy on left-right direction if negative: Code is bug 2.We apply the inversion code" if positive: this mean the relighting that not working right now is the problem of model training (either convergence problem or the dataset problem or the algorithm itself has problem.) if negative: the inversion code has bug

[pureexe]

Let's look back.

With the setting of VAE as an encoder that encode environment map to latent code. The overall light direction is average at 78% at the epoch 225 while in X-minus direction got 99% and X-plus direction got 100%

So, we currently expected to replicate this thing first.

[pureexe]

Update 09/09 Left/Right still have the same accuracy. So the code is still working correctly as we expected for the left/right. Then we should try with the inversion

[pureexe]

Update: We got at most 97.5% accuracy with LR=5e-5, epoch=239 guidance scale =1