search

Fantom-foundation / Tosca

Other
12 stars 12 forks source link

CT: support collection of interpreter code coverage #405

Open HerbertJordan opened 6 months ago

HerbertJordan commented 6 months ago

To understand the effectiveness of the CT test case generator in generating tests for EVM implementations, the code coverage in the implementations when running the CT tests should be measured.

If branches in the implementation are not covered, they are either dead code, redundant, or an indication that further refinements of the rules in the CT specification are required.

Ideally, the interpreter code coverage should be 100% and continuously tested using nightly builds.

facuMH commented 3 months ago

Makefile commands adding support for coverage for lfvm was added in #553, and for geth in #618. These commands generate the report in html function. It should be researched how to convert these results into a format that jenkins can pick up and report automatically.

LuisPH3 commented 3 months ago

evmzero support with #623

LuisPH3 commented 3 months ago

Now we need to add it to the nightlies,