Any updates in generating dynamic shape images?

vitoplantamura / OnnxStream

Lightweight inference library for ONNX files, written in C++. It can run Stable Diffusion XL 1.0 on a RPI Zero 2 (or in 298MB of RAM) but also Mistral 7B on desktops and servers. ARM, x86, WASM, RISC-V supported. Accelerated by XNNPACK.

https://yolo.vitoplantamura.com/

Other

1.86k stars 84 forks source link

Any updates in generating dynamic shape images? #69

Open Meshwa428 opened 7 months ago

Meshwa428 commented 7 months ago

Like you mentioned in #44 that in the next version of onnxstream we will be able to generate dynamically shaped images

Any progress so far? Any updates?

Thanks in advance

vitoplantamura commented 7 months ago

hi,

yes, OnnxStream (the library!) now supports dynamic shapes for inputs, via the m_support_dynamic_shapes option.

This was done to be able to run TinyLlama and Mistral7B; the Stable Diffusion application has not been updated.

I plan to do some tests in the future to support custom width and height in the SD application, but I can't determine a release date for this feature at the moment... :-(

Vito

Meshwa428 commented 7 months ago

No, probs I will try to implement it by my self and let you know when I'm done 😉

vitoplantamura commented 7 months ago

cool!

Let me know about your progress here!

thanks, Vito