search

bes-dev / stable_diffusion.openvino

Apache License 2.0
1.53k stars 207 forks source link

FP16 support #117

Closed ngaloppo closed 1 year ago

ngaloppo commented 1 year ago

Hello! Would it be possible to make FP16 models available for faster GPU execution? Since you have only made the FP32 OpenVINO IR available, there is no way to compress to FP16 with Model Optimizer.

bes-dev commented 1 year ago

@ngaloppo hello! We provide source ONNX files for sd-1.4 . Did you try to create FP16 OpenVINO IR using these ONNX models?

ngaloppo commented 1 year ago

I didn't realize you had released the ONNX files. Thank you, that should work!