openvinotoolkit / stable-diffusion-webui

Stable Diffusion web UI
GNU Affero General Public License v3.0
290 stars 45 forks source link

[Feature Request]: Add Intel® Extension for PyTorch support #94

Closed Micraow closed 10 months ago

Micraow commented 10 months ago

Is there an existing issue for this?

What would your feature do ?

By using Intel® Extension for PyTorch , we can take advantages of AVX-512 Vector Neural Network Instructions (AVX512 VNNI) and Intel® Advanced Matrix Extensions (Intel® AMX) on Intel CPUs through a few lines of changes. That can speed up the inference.

Proposed workflow

This should go background, so the user may only notice the speed is faster.

Additional information

No response

cavusmustafa commented 10 months ago

Thank you for the suggestion. OpenVINO backend already takes advantage of AVX512 and AMX and provides the best optimizations for the target Intel® device. At present, we find no necessity to change the backend.