Model size isn't reducing

[sravanthOppo27]

Dear Author , I have tried your code but there isn't any model size reduction for the UNET Part . Is this only Inference speed up mechanism or is there any model size reduction part ??. Am I doing any thing wrong ?

[AlexKoff88]

Hi,

Thanks for the interest. The reduction happens when you convert model to OpenVINO representation.

You can compare yourself:

• FP32: https://huggingface.co/OpenVINO/stable-diffusion-pokemons-fp32/tree/main/unet
• INT8: https://huggingface.co/OpenVINO/Stable-Diffusion-Pokemon-en-quantized/tree/main/unet

[sravanthOppo27]

Okay , Your code is direct implementation of OpenVINO ?

or better than OpenVINO ( mean lesser model size & Faster inference speed up )

[AlexKoff88]

Actually, the training in the script is done using PyTorch and after the training process finishes the model is exported to OpenVINO representation (.xml and .bin files) and model size is reduces.