search

rupeshs / fastsdcpu

Fast stable diffusion on CPU
MIT License
1k stars 87 forks source link

Realtime code doesn't load up all 128 threads in my AMD EPYC via OPENVINO #101

Closed monstercameron closed 7 months ago

monstercameron commented 7 months ago

Realtime code doesn't load up all 128 threads in my AMD EPYC. Is there a way to config openvino to load up all my cores for the experimental realtime ui?

Can you expose an option to specify CPU cores

Current benchmark results @5 steps: 100%|██████████████████████████████████████████████████████████| 5/5 [00:02<00:00, 2.00it/s] Latency: 2.96 seconds

monstercameron commented 7 months ago

Screenshot 2023-12-04 164536

rupeshs commented 7 months ago

Please try Pytorch(Simple disable OpenVINO). OpenVINO is mainly used for Intel CPUs.