Full Tutorial + 1 Click 12 GB VRAM Installer + Batch Upscale + Comparison With Magnific - SUPIR Starts A New Era

FurkanGozukara commented 8 months ago

I have dedicated several days, working over 12 hours each day, on SUPIR (Scaling-UP Image Restoration), a cutting-edge image enhancement and upscaling model introduced in the paper Scaling Up to Excellence: Practicing Model Scaling for Photo-Realistic Image Restoration In the Wild.

This model is simply mind-blowing. At the bottom of this post, you will see side-by-side comparisons of SUPIR versus the extremely expensive online service, Magnific AI. Magnific is known to be the best among the community. However, SUPIR is by far superior. SUPIR also significantly outperforms Topaz AI upscale. SUPIR manages to remain faithful to the original image almost 100% while adding details and achieving super upscaling with the best realism.

I made a full 33-minute tutorial, fully chaptered with manually written captions. The chapter's info is posted at the very bottom.

You can watch the video here: SUPIR: New SOTA Open Source Image Upscaler & Enhancer Model Better Than Magnific & Topaz AI Tutorial

SUPIR: New SOTA Open Source Image Upscaler & Enhancer Model Better Than Magnific & Topaz AI Tutorial

You can join our 6500+ member Discord for any help & discussion: https://discord.com/servers/software-engineering-courses-secourses-772774097734074388

Original repo of SUPIR: https://github.com/Fanghua-Yu/SUPIR

I have worked hard to make a 1-click installer for Windows & RunPod. RunPod uses Linux, thus if you are a Linux user you can use RunPod files to install locally on Linux as well with a 1-click install.

Full instructions are shared in this post along with the scripts: https://www.patreon.com/posts/supir-1-click-99176057

Here are the installer files:

The installer works with Python 3.10.11. It generates a new pip venv and installs everything there. So you don't need Conda. Since it will generate its own VENV, it will not affect any other installations on your system.

The installer installs xFormers and Triton (we are using a pre-compiled wheel) and Pytorch 2.2.0 automatically for you on Windows and Linux.

The Gradio app launching interface is shown below:

Currently, with the newest optimizations, the SUPIR app works great on RTX 3060 without LLaVA. I have tested it on my 12 GB single RTX 3060 GPU. So if you have a GPU that has 12GB or more VRAM, you can use it.

The installer downloads all models automatically as well. Also, I changed the base SDXL model with Juggernaut XL - V9 since it works better.

You can simply use any SDXL model. Instructions are on the Patreon post.

I also greatly improved the base Gradio APP. I made the interface more usable.

I added the number of images and randomized seed features. I made the image upscale scaler 0.1 precision.

Moreover, I have added a batch upscale feature as well.

You can see the improved advanced Gradio app interface below.

All the images the app generates will be automatically saved under the outputs folder. You can define the batch image processing outputs folder as well.

Here is the content of the Patreon post:

The chapters of the tutorial are as follows:

0:00 Introduction to SUPIR (Scaling-UP Image Restoration) full tutorial
2:10 How to download and install SUPIR on Windows or RunPod (thus Linux)
3:19 How to setup a community Pod on RunPod's newest interface
4:33 How to install and start SUPIR on RunPod
7:10 How to use Proxy connect of RunPod
8:13 How to install and start our own quantization supporting LLaVA
9:22 Getting image description from our own LLaVA model
9:42 How to use SUPIR interface and testing camel image (test image 1) on SUPIR in details
12:07 Testing a very old family photo enhancement and upscaling with SUPIR (test image 2)
14:34 Where the generated images are saved
14:53 Testing the image of Arnold Schwarzenegger as a warrior (test image 3) on SUPIR in details
16:22 The effect of simple prompt vs detailed prompt
17:30 Testing a dragon statue enhancement and upscaling with SUPIR (test image 4)
17:42 How I used ChatGPT Plus / GPT-4 for image captioning
18:29 The model works with literally every resolution and example very big upscale
19:00 Testing image of a dinosaur in jurassic park image enhancement and upscaling with SUPIR (test image 5)
19:41 From 500px to 3000px upscale results and how to do very big upscale properly
22:39 GPU utilization of the SUPIR scripts
23:15 If you get out of VRAM error what can you do and how you can solve
25:22 Testing a MonsterMMORPG Game character (anime like drawing) upscaling and image enhancing (test image 6)
25:39 What to do if your image has transparent pixels to be able to upscale
27:35 Testing a black and white colored movie screenshot of a man image enhancement and upscaling with SUPIR (test image 7)
28:29 Testing a screenshot from the movie Predator enhancement and upscaling with SUPIR (test image 8)
29:12 The queue ability of the Gradio app of SUPIR
29:49 Testing an old photo of Muhammad Ali in a boxing stance image enhancement and upscaling with SUPIR (test image 9)
30:45 Testing a black and white colored movie screenshot of Charlie Chaplin image enhancement and upscaling with SUPIR (test image 10)

SUPIR vs MAGNIFIC AI

Carefully look at the how much SUPIR can be loyal to the original image vs Magnific can be loyal to original image

base_ali

magnific_ali

supir_ali

base_dino

dino_magnific

dino_supir

base_family

magnific_family

supir_family

base_camel

magnific_camel

supir_camel

base_vampire

magnific_vampire

supir_vampire

base_dragon

magnific_dragon

supir_dragon

base_arnold

magnific_arnold

supir_arnold

base_predator

magnific_predator

supir_predator

base_charlie

magnific_charlie

supir_charlie

base_monster

magnific_monster

supir_monster

zelenooki87 commented 8 months ago

You deserve ban for posting your "premium" sh**y stuff here. Everything can be done with following authors readme file.

Revln9 commented 8 months ago

Can you please ban this guy ?

JasonGUTU commented 8 months ago

Hello and thanks for your work! You made a great video and your results are very important to us. Maybe someone else thinks it's inappropriate to post this as an issue. We can make it better and find you a better place to share your thoughts!

FurkanGozukara commented 8 months ago

Hello and thanks for your work! You made a great video and your results are very important to us. Maybe someone else thinks it's inappropriate to post this as an issue. We can make it better and find you a better place to share your thoughts!

Thank you so much. I will hopefully make more people to know this Model. It is not getting the attention it deserves.

friendlyFriend4000 commented 8 months ago

https://github.com/Fanghua-Yu/SUPIR

no paywall, one click installer

Akarity commented 8 months ago

I tried to install, based on the readme, but got a bunch of errors when installing requirements.

2024-02-28 22_47_26-Anaconda Prompt

FurkanGozukara commented 8 months ago

@Akarity I made it installed via Python 3.10.11 venv. I really don't like Conda

OoAnikioO commented 8 months ago

https://github.com/Fanghua-Yu/SUPIR

no paywall, one click installer

there is no one click installer on this page

FurkanGozukara commented 8 months ago

New updates added to our Gradio. I keep adding features requested by the supporters

https://www.patreon.com/posts/99176057

image metadata

updated interface

csatoshii commented 8 months ago

people would have less of a problem with this he didn't put it behind a paywall. this isn't helping anyone but his own pockets. Sure people need to make money, but it's done in such a sh*tty and spammy way - everywhere!

FurkanGozukara commented 8 months ago

Just updated to V19