search

bes-dev / stable_diffusion.openvino

Apache License 2.0
1.53k stars 207 forks source link

Benchmarks for low end CPUs #130

Open brappier opened 1 year ago

brappier commented 1 year ago

I am interested in seeing whats the speed on CPUs like 2011 i5 macbook air. has anyone tried?

brmarkus commented 1 year ago

Being based on OpenVINO the system requirements under "https://www.intel.com/content/www/us/en/developer/tools/openvino-toolkit/system-requirements.html" sais

Processors 6th to 13th generation Intel® Core™ processors 1st to 4th generation Intel® Xeon® Scalable processors

Do you know which CPU/SoC generation is in the "" you are referring? From "https://everymac.com/systems/apple/macbook-air/specs/macbook-air-core-i5-1.7-13-mid-2011-specs.html" it reads like

This model is powered by a 32 nm, 64-bit Intel Mobile Core i5 "Sandy Bridge" (I5-2557M) processor which includes two independent processor "cores" on a single silicon chip. Each core has a dedicated 256k level 2 cache, shares 3 MB of level 3 cache, and has an integrated memory controller (dual channel).

which means it's Core-i5 2557M, which means 2nd generation... that would be too old for using a recent version of OpenVINO...

espio999 commented 1 year ago

single token per around a minute in the case of i5-8250U + 8GB RAM.

https://impsbl.hatenablog.jp/entry/GPTOnLinuxPCwith8GB-RAM_en

rouanb commented 1 year ago

I'm getting 7.30s/it on stock settings i5 8365U + 16GB RAM. Also dumb question but is it using 15-16GB of RAM for anyone else? I only have 12Gb on my Linux VM and have to give it 5Gb of swap to play with, does this slow down the time per iteration?