huggingface / optimum-intel

🤗 Optimum Intel: Accelerate inference with Intel optimization tools

https://huggingface.co/docs/optimum/main/en/intel/index

Apache License 2.0

409 stars 112 forks source link

enable t5 in SD3 pipe testing and flux img2img and inpaint #1016

Closed eaidova closed 19 minutes ago

eaidova commented 3 days ago

What does this PR do?

enable text_encoder_3 in SD3 testing for resolving https://github.com/huggingface/optimum-intel/issues/965
enable flux img2img pipeline (was introduced in diffusers 0.31.0, previous version was based on 0.30.0)
added test that save_pretrained returns correct model_index.json

Before submitting

[ ] This PR fixes a typo or improves the docs (you can dismiss the other checks if that's the case).
[ ] Did you make sure to update the documentation with your changes?
[x] Did you write any new necessary tests?

HuggingFaceDocBuilderDev commented 3 days ago

The docs for this PR live here. All of your documentation changes will be reflected on that endpoint. The docs are available until 30 days after the last update.

eaidova commented 2 days ago

@nikita-savelyevv flux does not have text_encoder_3, it is expected. there is no changes in model export part for text_encoder_3, only its ignoring removed in tests. During writing tests I found that compilation of small t5 model used in test sd3 model failed with segfault on compilation stage, but this issue does not appear in real big models, so I disable loading of this model in tests i(it is optional part of sd3 pipeline and model can work without it, just with small accuracy drop). Now in 2024.5 issue was fixed