search

apalache-mc / apalache-tests

Benchmarks for apalache
Apache License 2.0
6 stars 2 forks source link

Add buggy benchmarks #4

Open konnov opened 4 years ago

konnov commented 4 years ago

Currently, all the tests are assumed to report NoError. Add configurations, where errors are expected.

shonfeder commented 4 years ago

Any preference on the priority here? If we get https://github.com/informalsystems/apalache/issues/86 in place first (perhaps also providing an option to output JSON, if that would be useful), then we can overhaul the current text munging to just use simple data processing on the resulting serialized output. That should help clean up the scripts a bit, and be more robust in the long term.

konnov commented 4 years ago

It is not really a priority. But let's not forget about it, as we do not want unexpected false positives.