kijai / ComfyUI-SUPIR

SUPIR upscaling wrapper for ComfyUI
Other
1.49k stars 82 forks source link

Quick question regarding fp8 #77

Closed Archit01 closed 6 months ago

Archit01 commented 6 months ago

Does fp8 works with 8gb vram and 16gb ram ? Can it be implemented with tiling and offloading of models ? No matter if it is slow if it works I kindly request for this implementation.

kijai commented 6 months ago

It should fit 8GB VRAM with smallish dimensions/tile size with fp8, but I'm not sure if it all will fit 16GB RAM. Everything regarding that is already implemented.

GaleBoro commented 6 months ago

I've been able to run it with 8gb vram and 16gb ram with the following settings. image

kijai commented 6 months ago

I've been able to run it with 8gb vram and 16gb ram with the following settings. image

Nice, that's very good to know!