search

vladmandic / sd-extension-system-info

System and platform info and standardized benchmarking extension for SD.Next and WebUI
https://vladmandic.github.io/sd-extension-system-info/pages/benchmark.html
MIT License
280 stars 51 forks source link

Fix IPEX with torch.version.cuda hijack #37

Closed Disty0 closed 11 months ago

Disty0 commented 11 months ago

Hijacking torch.version.cuda gives %15 extra boost on Diffusers. But hijacking torch.version.cuda breaks System Info. This PR fixes it.

vladmandic commented 11 months ago

Hijacking torch.version.cuda gives %15 extra boost on Diffusers.

what??

Disty0 commented 11 months ago

I don't really know why. Probably an autocast issue or something runs on the CPU.

8.20 it/s without and 9.8 it/s with torch.version.cuda hijack. 9.8 it/s is also what i get with OpenVINO.

vladmandic commented 11 months ago

almost 10its, intel is getting to be pretty decent option at that price point!

Disty0 commented 11 months ago

Some people are getting 11.5 it/s with OpenVINO. A single CPU core is at %100 when SD is running on my side. And Training is also working on Kohya and RVC with IPEX. Intel is pretty decent if it's supported properly.