search

imxieyi / waifu2x-ios-model-converter

Apache License 2.0
57 stars 3 forks source link

Please could I request a conversion for models GFPGAN-1.3.8 and Basic SR Face Restoration? #2

Open finimusmaximus opened 1 year ago

finimusmaximus commented 1 year ago

I feel these two models are missing in the Waifu2x app and would greatly benefit from having them. Thanks :-)

imxieyi commented 1 year ago

These models are not based on ESRGAN architecture, therefore they are unsupported. I'll take a look but don't get your hopes too high.

finimusmaximus commented 1 year ago

Thank you :-)

imxieyi commented 1 year ago

GFPGAN face restoration does not use a single model. It performs a series of steps:

  1. Detect faces in the image (looks like it only crops out face part without any background, not simple rectangle crop).
  2. Upscale detected faces with GFPGAN model.
  3. Upscale background with Real-ESRGAN.
  4. Blend upscaled faces onto upscaled background (not simple copy pasting).

Currently this app only supports "dumb" upscaling with a single model. To support GFPGAN it will require very significant efforts, especially on step 1 and 4 as they are not straightforward.

Considering that face restoration is not the main purpose of this app, GFPGAN will not be supported in foreseeable future.

finimusmaximus commented 1 year ago

Thank you for your help. I completely understand

finimusmaximus commented 1 year ago

Hi there again, I wanted to ask if there are any other models I could download for the waifu app that aren’t in the Google drive link that you have attached. Thanks.

imxieyi commented 1 year ago

You can take a look at upscale.wiki. Most models on this page are supported. But only those with a permissive license can be provided in converted form. Others will need to be converted by yourself.

I added Colab converter to convert known models. Please take a look to get started.