search

MountaintopLotus / braintrust

A Dockerized platform for running Stable Diffusion, on AWS (for now)
Apache License 2.0
1 stars 2 forks source link

Upscaling #34

Closed JohnTigue closed 1 year ago

JohnTigue commented 1 year ago

Upscaling is one of the basic techniques with generative AI tooling.

JohnTigue commented 1 year ago

Comparing the different upscalers for realistic content

JohnTigue commented 1 year ago

The DEFINITIVE Comparison to Upscalers 2022-10

JohnTigue commented 1 year ago

GitHub: Ultimate SD Upscale extension for A111 (License is GPL-3.0)

JohnTigue commented 1 year ago

Protip: the upscaler matters a lot

JohnTigue commented 1 year ago

In InvokeAI, there is an upscaler called Embiggen:

Embiggen: upscale your images on limited memory machines

GFPGAN and Real-ESRGAN are both memory intensive. In order to avoid crashes and memory overloads during the Stable Diffusion process, these effects are applied after Stable Diffusion has completed its work. … If you wanted to be able to do more (pixels) without running out of VRAM, or you want to upscale with details that couldn't possibly appear without the context of a prompt, this is the feature to try out.

Embiggen automates the process of taking an init image, upscaling it, cutting it into smaller tiles that slightly overlap, running all the tiles through img2img to refine details with respect to the prompt, and "stitching" the tiles back together into a cohesive image.

JohnTigue commented 1 year ago

Weird. Upscaling in the model? ULTRA SHARP Upscale! - Don't miss this Method!!! / A1111 - NEW Model

JohnTigue commented 1 year ago

ULTIMATE Upscale for SLOW GPUs - Fast Workflow, High Quality, A1111 gets into tiling upscaling.