RealScaler - image/video AI upscaler app (Real-ESRGAN)

What is RealScaler?

RealScaler is a Windows app powered by RealESRGAN AI to enhance, upscale and de-noise photos and videos.

Other AI projects.🤓

• https://github.com/Djdefrag/QualityScaler / QualityScaler - image/video AI upscaler app
• https://github.com/Djdefrag/FluidFrames.RIFE / FluidFrames.RIFE - video AI interpolation app (RIFE-HDv3)

Credits.

Real-ESRGAN - https://github.com/xinntao/Real-ESRGAN

How is made. 🛠

RealScaler is completely written in Python, from backend to frontend. External packages are:

• AI -> torch / onnxruntime-directml
• GUI -> customtkinter
• Image/video -> OpenCV / moviepy
• Packaging -> nuitka

Requirements. 🤓

• Windows 11 / Windows 10
• RAM >= 8Gb
• Any Directx12 compatible GPU with >= 4GB VRAM

Features.

• [x] Elegant and easy to use GUI
• [x] Image and Video upscale
• [x] Multiple GPUs support
• [x] Compatible images - jpg, png, tif, bmp, webp, heic
• [x] Compatible video - mp4, wemb, mkv, flv, gif, avi, mov, mpg, qt, 3gp
• [x] Automatic image tilling to avoid gpu VRAM limitation
• [x] Resize image/video before upscaling
• [x] Interpolation beetween original file and upscaled file
• [x] Video upscaling STOP&RESUME
• [x] PRIVACY FOCUSED - no internet connection required / everything is on your PC

Next steps. 🤫

• [x] 1.X versions
  • [x] Switch to Pytorch-directml to support all Directx12 compatible gpu (AMD, Intel, Nvidia)
  • [x] New GUI with Windows 11 style
  • [x] Include audio for upscaled video
  • [x] Optimizing video frame resize and extraction speed
  • [x] Multi GPU support (for pc with double GPU, integrated + dedicated)
  • [x] Python 3.10 (expecting ~10% more performance)
• [x] 2.X versions
  • [x] New, completely redesigned graphical interface based on @customtkinter
  • [x] Upscaling images and videos at once (currently it is possible to upscale images or single video)
  • [x] Upscale multiple videos at once
  • [x] Choose upscaled video extension
  • [x] Interpolation between the original and upscaled image/video
  • [x] More Interpolation levels (Low, Medium, High)
  • [x] Show the remaining time to complete video upscaling
  • [x] Support for SRVGGNetCompact AI architecture
  • [x] Metadata extraction and application from original file to upscaled file (via exiftool)
• [ ] 3.X versions
  • [x] New AI engine powered by onnxruntime-directml (https://github.com/microsoft/onnxruntime))
  • [x] Python 3.11 (performance improvements)
  • [x] Python 3.12 (performance improvements)
  • [x] Display images/videos upscaled resolution in the GUI
  • [x] Updated FFMPEG to version 7.x (latest release)
  • [x] Saving user settings (AI model, GPU, CPU etc.)
  • [x] Video multi-threading AI upscale
  • [x] Video upscaling STOP&RESUME

Some Examples.

Videos

• Original

• RealESRGANx4 - upscaled in 3 minutes and 23 seconds

https://user-images.githubusercontent.com/32263112/209639499-83eb4609-a842-43f9-b8a2-9fffd23e1d2c.mp4

• RealESR_Gx4 - upscaled in 57 seconds

https://user-images.githubusercontent.com/32263112/209639569-c201a965-c6bf-4b7c-9904-61114b5bf4d5.mp4

Images!