search

ethereum / retesteth

testeth via RPC. Test run, generation by t8ntool protocol
http://retesteth.ethdevops.io/
GNU General Public License v3.0
113 stars 75 forks source link

Crash during BlockchainTests execution #128

Closed jvdp closed 3 years ago

jvdp commented 3 years ago

When running retesteth -t BlockchainTests I get the following crash:

...
*** 22 failures are detected in the test module "EthereumTests"
terminate called after throwing an instance of 'boost::filesystem::filesystem_error'
  what():  boost::filesystem::directory_iterator::construct: No such file or directory: "/var/lib/buildkite-agent/builds/buildkite-i-03206de417802bded-2/input-output-hk/mantis/ets/tests/src/VMTestsFiller"
Finishing retesteth run

The exit code is 134.

The mentioned path does indeed not exist, but should it be or is this a bug? This is with version 8.0.3 of ethereum/tests.

jvdp commented 3 years ago

@winsvega do you have any idea what could be the problem?

winsvega commented 3 years ago

Is it on retesteth develop branch? The vm tests got removed. Its in tge legacy folder now. And in state tests.

The daily build doesn't show such problem

jvdp commented 3 years ago

It is with version v0.1.0-accesslist_fix of retesteth, and 8.0.3 of ETS. Is that an incompatible combination?

(It was running -t BlockchainTests btw, not anything in the legacy folder.)

winsvega commented 3 years ago

the tests are changing it is better to use retesteth/develop to run the recent state change. accesslist_fix is for tests 8.0.0

winsvega commented 3 years ago

this really is a boost problem. need dynamic test suites and custom test runner. currently all test suites are hardcoded by boost