Generating diffs for incremental benchmarks - Githubissues

goblint / bench

The benchmark suite

4 stars 5 forks source link

Generating diffs for incremental benchmarks #6

Open vesalvojdani opened 2 years ago

vesalvojdani commented 2 years ago

In order to create a large-scale incremental benchmarking suite, it would be useful to automate the diff generation process.

Find some mutation testing tool that allows easy creation of mutants
Make these mutations in the forms of diffs that we can use in our benchmarking scripts.
Create a sensible set of diffs for our test programs.

It would be important to check if the tool works on our test program, including linux device drivers, before committing to it.