Open theoldsong opened 1 month ago
I see someone using the CPU uninstallation method to implement, how do you operate, thank you
reference: https://www.bilibili.com/video/BV1by411h7Vg/?vd_source=a25b27836b1cea089a7471b5f6f899cd at 42s
edit gradio_demo/app.py add code after line 130 (130 : pipe.unet_encoder.to(device))
pipe.enable_sequential_cpu_offload()
only need 8G
reference: https://www.bilibili.com/video/BV1by411h7Vg/?vd_source=a25b27836b1cea089a7471b5f6f899cd at 42s
edit gradio_demo/app.py add code after line 130 (130 : pipe.unet_encoder.to(device))
pipe.enable_sequential_cpu_offload()
only need 8G
Can you post the code here? That site only allows high resolution via registration...
I have seen that many people have implemented this program under 8G VRAM, and the speed is still fast. The author does not provide a similar implementation method. How can I do it?