search

vitoplantamura / OnnxStream

Lightweight inference library for ONNX files, written in C++. It can run Stable Diffusion XL 1.0 on a RPI Zero 2 (or in 298MB of RAM) but also Mistral 7B on desktops and servers. ARM, x86, WASM, RISC-V supported. Accelerated by XNNPACK.
https://yolo.vitoplantamura.com/
Other
1.86k stars 84 forks source link

Docker image #7

Closed BasToTheMax closed 1 year ago

BasToTheMax commented 1 year ago

Is there a docker image available for building SD and running OnnxStream?

vitoplantamura commented 1 year ago

hi,

Docker introduces a small memory overhead. While this overhead is negligible on most modern desktop and server systems, it can be problematic on microcomputers such as the RPI Zero 2, with software such as OnnxStream where even the single KB matters.

Vito