shapr / kudzu

coverage driven random testing framework
BSD 3-Clause "New" or "Revised" License
21 stars 2 forks source link

KUDZU will slowly grow to cover all of your code

Kudzu is a library that throws test cases at your property tests until the code coverage no longer increases.

WHY?

Property testing has no feedback loop, you randomly choose a number of test cases and hope for the best.

How do you know if your property tests were any good? The best feedback I know is to use hpc and look at the pretty colored HTML output to see what code was exercised.

But wait, why do I have to look at the output? Isn't that why we have computers?

HOW?

In Haskell, you can get code coverage results while your program is running!

WHAT FEEDBACK LOOP?

The simplest feedback loop is to keep running random tests until new code coverage stops increasing.

HOW DO I MAKE IT GO?

  1. add kudzu to your test-suite depends,
  2. import the Kudzu module
  3. call the testUntil function of your choice
    1. testUntilSameQCMany or testUntilSameQC
    2. testUntilSameHHMany or testUntilSameHH
    3. testUntilSameLCMany or testUntilsameLC
  4. run with cabal test --enable-coverage

TELL ME MORE

The best write up of this idea is Random Test Generation, Coverage Based.

TODO

EXAMPLE

You can see kudzu in use in the tests for takedouble