invoke-ai / InvokeAI

InvokeAI is a leading creative engine for Stable Diffusion models, empowering professionals, artists, and enthusiasts to generate and create visual media using the latest AI-driven technologies. The solution offers an industry leading WebUI, supports terminal use through a CLI, and serves as the foundation for multiple commercial products.
https://invoke-ai.github.io/InvokeAI/
Apache License 2.0
22.27k stars 2.32k forks source link

[enhancement]: Investigate using `spandrel` for upscaling and image restoration #6394

Open psychedelicious opened 1 month ago

psychedelicious commented 1 month ago

Is there an existing issue for this?

Contact Details

No response

What should this feature add?

spandrel is a module extracted from the chaiNNer project that facilitates loading and running ML models. The focus is on image restoration workflows. Many architectures are supported. A1111 uses this in some fashion.

We should explore leveraging this library to extend our upscaling capabilities.

Alternatives

No response

Additional Content

No response

psychedelicious commented 1 month ago

@RyanJDick Any thoughts on relying on spandrel for upscaling? Maybe this can be a solid base for our upcoming upscaling sprint.