MunchkinChen / FADING

26 stars 2 forks source link

Understanding re-aging results #4

Open luchaoqi opened 2 months ago

luchaoqi commented 2 months ago

Hello, thanks for this awesome work! I have a question trying to understand the following re-aging results, given an input face here:

I got the following different results with the same inference code: python age_editing.py --image_path xxx --age_init 39 --gender male --save_aged_dir xxx --specialized_path xxx --target_ages 0 10 20 30 40 50 60 70 80 90 100 image image image Do you have any idea why the results are not deterministic in the above case?

Also in case 2:

image Do you have any idea why there are artifacts?

gh-BumsooKim commented 3 days ago

Hi, I'm not an author of this paper, but have some insight.

First, I conjecture artifacts are raised by non-enough optimization in null-text optimization process (before Prompt2Prompt editing process) or huge gap between source prompt and inputted image. One potential solution is to increase the steps of null-text optimization to obtain more faithful null-text embeddings. To do that, you can modify num_inner_step in https://github.com/MunchkinChen/FADING/blob/14fefbf7edbf5b1d3f867bd4720a61bfc1bdf2c0/null_inversion.py#L152

like from num_inner_step=10 to num_inner_step=20. It takes more time, but might generate more faithful results.


In addition, I observed that input age also affects the resulting images like below figure:

image

To mitigate this issue, you can use off-the-shelf age estimator (e.g., DEX, InsightFace) than age constant via command line.

I hope it works well 😀