0xPolygonMiden / miden-vm

STARK-based virtual machine
MIT License
611 stars 148 forks source link

Add mutation testing strategy #1317

Open hackaugusto opened 2 months ago

hackaugusto commented 2 months ago

I was thinking on how to test our constraints automatically, to either verify that no constraints are missing, or to automatically find issues. And it occurred to me that mutation testing would be a good approach. The idea is to do the following:

The same can be done for verifying, by:

If we write many minimal correct programs, each using a different instructions, and run the above strategy for each of said programs, we should have good coverage.

Bisht13 commented 2 months ago

Hey @hackaugusto! Can I pick this up?

hackaugusto commented 2 months ago

@bobbinth ping. I'm not sure if you want to implement this or if there are conflicting plans.

@Bisht13 just a heads up, this is probably an involved task.

Bisht13 commented 2 months ago

@hackaugusto I was scouting over the repo and wanted an issue to collaborate on, if you have anything on top of your mind, I'd love to pick it up, though I have no issue with picking this up as well.