search

1j01 / rezzy-zoom-and-enhance

🔎✨ Zoom and Enhance browser extension (AI powered)
28 stars 6 forks source link

Portable upscaling AI (wasm / webgl / webgpu) #11

Open 1j01 opened 2 years ago

1j01 commented 2 years ago

Currently I use waifu2x-converter-cpp for superresolution, on a server which lives outside of the browser extension, and communicates with the web page over socket.io. The biggest issue with this browser extension is that it's hard to set up. I would have published it already if it didn't require a separate install from the browser extension.

I just did a proof of concept for using Anime4K.js on a branch. There's performance problems (blocking the page), but that's easy to resolve, just need the computation to be in a worker (or the extension's background page). Cross-origin images are no longer handled, but that's solvable as well. The real problem is the quality of the output. Text looks very blurry/ugly. I wonder if the upstream project Anime4K has improvements that the JS port lacks, or if text is just a bad case for Anime4K.

There are other shaders and algorithms to compare.

FlotingDream commented 1 year ago

Thx for your interesting repo, I am wondering if it is possible to combine with https://github.com/Suwayomi/Tachidesk-Server something support formatted multi-source and with browser web view. thx! :)

1j01 commented 1 year ago

@FlotingDream Sounds possible, sounds vaguely like what I was imagining this project could be (see IDEAS.md). I don't know what you're specifically imagining, but probably the underlying super-resolution algorithm/program (waifu2x-converter-cpp) can be slotted into another project more easily than trying to use anything from this codebase. Most of my code concerns communicating between waifu2x-converter-cpp and web pages via a browser extension, but it's probably irrelevant in another scenario. So what are you thinking?