microsoft / knossos-ksc

Compiler with automatic differentiation
Other
45 stars 10 forks source link

Some correctness bugs are not found in CI #1045

Open awf opened 2 years ago

awf commented 2 years ago

From #1034, some correctness bugs are not found in CI, because we have some benchmarks which are expected to give incorrect results (the embedded_INCORRECT benchmarks).

Maybe we should disable those benchmarks in CI so that we can fail the build if another example breaks?

Or we should test correctness unless benchmark is labelled as "incorrect".