rust-ethereum / evm

Pure Rust implementation of Ethereum Virtual Machine
Apache License 2.0
1.16k stars 355 forks source link

Feat: Add statistics info for jsontests #258

Closed mrLSD closed 9 months ago

mrLSD commented 9 months ago

Description

➡️ At the moment, when tests are run, the output results are uninformative and difficult to analyze. This PR adds minimal statistical information to the tests passed and changes the output to make it more convenient to analyze.

🌇 Changes

[FORK_NAME] SHORT_TEST_FILE_NAME | TEST_NAME/INDEX: COMPLETION_STATUS

✅ Example output for a single test

[Berlin] VMTests/vmTests/calldataload.json | calldataload/2: ok
[Cancun] VMTests/vmTests/calldataload.json | calldataload/0: skipped

✅ Example statistic info output

COMPLETED: 3 tests
SKIPPED: 15 tests

TOTAL tests for: jsontests/res/ethtests/GeneralStateTests/VMTests/vmTests/
    COMPLETED: 136
    SKIPPED: 680

TOTAL: 5240 tests
    COMPLETED: 772
    SKIPPED: 4468