lllyasviel / Fooocus

Focus on prompting and generating
GNU General Public License v3.0
39.98k stars 5.52k forks source link

[Feature Request]: facial restoration #2796

Open LiveFreeDead opened 4 months ago

LiveFreeDead commented 4 months ago

Is there an existing issue for this?

What would your feature do?

Based on this 【much needed】 facial restoration integrated into Fooocus #293

I still think it needs to have the option of codeformer, to allow it to be used for Photo Restorations, the method mentioned in the existing thread changes the face to other people.

Proposed workflow

Original Concept preposed, but maybe you could get away with a check box saying keep Identity (can still apply skin cleanups, define hair etc, but keeping it closer to the source than the current method allows (it really does change the face a lot, even when you set it to 1 and 0 in the weights).

Additional information

Just try it out on one of your own family photos or even a selfie and you'll see what i mean.

ILikeToasters commented 4 months ago

Just want to mention you can use the improve detail feature with Faceswap.

mashb1t commented 4 months ago

@LiveFreeDead I'm really not certain if this can improve the images as much as inpainting. Leaving this as enhancement for now, but just wanted to let you know that prio is very low here.

DavidDragonsage commented 3 months ago

For appeal to new or casual users, I do think that the inclusion of GFPGAN and Codeformer would fit into the user friendly philosophy of Fooocus. I absolutely agree that Inpainting creates much better results, but this ideal of instant face fixing would be attractive to many people.

I remember that it took quite a while before my wife was comfortable with Inpainting, although she is an accomplished visual artist. She had started with AUTOMATIC1111 and so she was used to the instant results with GFPGAN and Codeformer. She really appreciated switching to Fooocus for its speed and uncluttered interface, but she certainly missed those two features, as well as Reactor quality face swapping.

She has since put a huge amount of time into Fooocus and the quality of Fooocus Inpainting has become one her favourite features. When she does use non-Stable Diffusion generators, the images almost always end up in Fooocus for finishing with Inpainting.

However, there are many Fooocus users without that level of artistic commitment (like my wife) or technical interest (like me). So for that audience, so called "facial restoration" would be a benefit.

But I agree, Manuel, this issue should probably be quite low priority. While I really enjoy using Fooocus, there are so many other aspects that could be improved with relatively little effort - or indeed are complete but waiting in the queue.