bytecodealliance / sightglass

A benchmark suite and tool to compare different implementations of the same primitives.
Apache License 2.0
69 stars 33 forks source link

image-classification benchmark failed #267

Open jlb6740 opened 1 year ago

jlb6740 commented 1 year ago

root@4722daa600d1:/sightglass# /sightglass/target/release/sightglass-cli benchmark --processes=3 --engine /sightglass/engines/wasmtime/libengine.so --raw --output-format csv --output-file /sightglass/benchmarks//results//image-classification_wasm_results.csv -- /sightglass/benchmarks/image-classification/image-classification-benchmark.wasm failed to instantiate

Caused by: unknown import: wasi_ephemeral_nn::load has not been defined thread 'main' panicked at 'assertion failed: (left == right) left: -1, right: 0', /sightglass/crates/recorder/src/bench_api.rs:221:9 note: run with RUST_BACKTRACE=1 environment variable to display a backtrace Error: benchmark subprocess did not exit successfully

rahulchaphalkar commented 4 months ago

This error was due to not using --engine-flags="--wasi nn". I've opened a PR to make setup of environment of the benchmark simpler.