search

vitoplantamura / OnnxStream

Lightweight inference library for ONNX files, written in C++. It can run Stable Diffusion XL 1.0 on a RPI Zero 2 (or in 298MB of RAM) but also Mistral 7B on desktops and servers. ARM, x86, WASM, RISC-V supported. Accelerated by XNNPACK.
https://yolo.vitoplantamura.com/
Other
1.85k stars 83 forks source link

Errors with ./sd #47

Open NickoDo opened 10 months ago

NickoDo commented 10 months ago

I built the example following the instructions on my Raspberry pi 4, compiled XNNPACK and OnxxStream, also downloaded the stable diffusion base image. When i execute ./sd --rpi --decoder-fp16 --steps 3 --output result.jpg i get: -bash: ./sd: Permission denied The same happens if i try to run ./sd by itself.

I have tried with chmod 777, copied the folder over to the SD card (was compiling and downloading all files to an extenral pen drive) and yet i get the same behaviour.

darkjacky commented 10 months ago

Have you tried chmod +x ?

technotip commented 2 months ago

I don't have a directory called sd inside /OnnxStream/src/build I created one and gave it appropriate permissions. But when I execute the prompt it says ./sd Is a directory

I've installed AeroX2 stable-diffusion-xl-turbo-1.0-onnxstream

technotip commented 2 months ago

I just realised my build process in the previous step is failing :-( I guess, the sd is not a directory but the object file after executing the sd.cpp file.

I'm trying to install all these on my Orange PI 5B device. I'm not sure if it is supported. The build process is failing: cmake --build . --config Release

Specs: Linux ubuntu 6.1.0-1023-rockchip # 23-Ubuntu SMP Wed Aug 14 23:55:18 UTC 2024 aarch64 aarch64 aarch64 GNU/Linux

gcc version 13.2.0 (Ubuntu 13.2.0-23ubuntu4)

Opened an issue: https://github.com/vitoplantamura/OnnxStream/issues/82