search

bytecodealliance / sightglass

A benchmark suite and tool to compare different implementations of the same primitives.
Apache License 2.0
69 stars 33 forks source link

Benchmark shootout-ackermann is not working for Wasm. #238

Closed jlb6740 closed 1 year ago

jlb6740 commented 1 year ago

Benchmark shootout-ackermann is not working for Wasm. Specifically the expected results do not match because the input files for m and n are not read. It appears the working-dir flag is either not working or not adequate.

jlb6740 commented 1 year ago

This may be an issue with the version of the wasi-sdk being used. Looking at strace output I do not even see an attempt to load the input file though I believe it is attempting to. But also, the assertation in the benchmark

https://github.com/bytecodealliance/sightglass/blob/f30862314d230b8986061a146881bee0b83a76b9/benchmarks/shootout-ackermann/benchmark.c#LL25C4-L25C4

that checks against the failure of creating a FD at the open attempt is not working. Will not open a separate issue for that just yet.