search

bytecodealliance / sightglass

A benchmark suite and tool to compare different implementations of the same primitives.
Apache License 2.0
69 stars 33 forks source link

Missing Expected Output Files #275

Open d-sonuga opened 4 weeks ago

d-sonuga commented 4 weeks ago

The benchmarks in benchmarks/libsodium are missing their expected stdout and stderr files.

jlb6740 commented 3 weeks ago

I believe the checker here uses the basename of the wasmfile as the basis for the filename used for stderr. This probably should change to something more generic so that we don't have a bunch of redundant stderr.expected files. In this case all benchmarks are expected to return '0' to stdout. Will confirm and work on the patch to make a default.stderr.expected and default.stdout.expected when we don't care for the distinction.