vitoplantamura / OnnxStream

Lightweight inference library for ONNX files, written in C++. It can run Stable Diffusion XL 1.0 on a RPI Zero 2 (or in 298MB of RAM) but also Mistral 7B on desktops and servers. ARM, x86, WASM, RISC-V supported. Accelerated by XNNPACK.
https://yolo.vitoplantamura.com/
Other
1.86k stars 84 forks source link

Raspberry Pi build. #1

Closed g8kig closed 1 year ago

g8kig commented 1 year ago

Please could you write down the Raspberry Pi build instructions because the supplied ones result in a runtime failure. Thanks.

vitoplantamura commented 1 year ago

hi,

please try the --rpi command line option.

thanks, Vito

g8kig commented 1 year ago

Thank you!