ethereum / retesteth

testeth via RPC. Test run, generation by t8ntool protocol
http://retesteth.ethdevops.io/
GNU General Public License v3.0
116 stars 76 forks source link

Error: CompareStates failed with errors: MissingExpectedAccount / address not expected to exist #189

Closed meowsbits closed 2 years ago

meowsbits commented 2 years ago
root@ubuntu-ny1-erigon:~/retesteth# ./bug-basefee.sh 
+ set -e
+ which evm
/usr/local/bin/evm
+ evm --version
evm version 1.11.0-unstable-b0d44338-20221031
+ git -C /root/tests status
On branch develop
Your branch is up to date with 'origin/develop'.

nothing to commit, working tree clean
+ rm -rf /root/.retesteth
+ ./build/retesteth/retesteth -t GeneralStateTests -- -j1 --filltests --testpath /root/tests --clients t8ntool
Running 65 test cases...
Running tests using path: /root/tests
Options path `/root/.retesteth` doesn't exist, attempt to create a new directory
Retesteth config path: /root/.retesteth
Active client configurations: 't8ntool '
Running tests for config 'Ethereum GO on StateTool' 2
Test Case "stCallCodes": (1 of 65)
WARNING: Error getting solc Version
25%...
50%...
75%...
100%
Error: Compare States: '0x00000000000000000000000000000000000e4971' address not expected to exist! (stCallCodes/touchAndGo, fork: Berlin, TrInfo: d: 0, g: 0, v: 0)
Error: Compare States: Missing expected address: '0x095e7baea6a6c7c4c2dfeb977efac326af552d87' (stCallCodes/touchAndGo, fork: Berlin, TrInfo: d: 0, g: 0, v: 0)
Error: CompareStates failed with errors: MissingExpectedAccount (stCallCodes/touchAndGo, fork: Berlin, TrInfo: d: 0, g: 0, v: 0)

--------
TestOutputHelper detected 3 errors during test execution!
/root/retesteth/retesteth/TestOutputHelper.cpp(222): error: in "GeneralStateTests/stCallCodes": 
Running tests for config 'Ethereum GO on StateTool' 2
Test Case "stCallCreateCallCodeTest": (2 of 65)
23%...
46%...
69%...
^CFinishing retesteth run
WARNING: Test folder /root/tests/src/GeneralStateTestsFiller/stArgsZeroOneBalance appears to be unused!
WARNING: Test folder /root/tests/src/GeneralStateTestsFiller/stAttackTest appears to be unused!
WARNING: Test folder /root/tests/src/GeneralStateTestsFiller/stBadOpcode appears to be unused!
WARNING: Test folder /root/tests/src/GeneralStateTestsFiller/stBugs appears to be unused!
WARNING: Test folder /root/tests/src/GeneralStateTestsFiller/stCallCreateCallCodeTest appears to be unused!
WARNING: Test folder /root/tests/src/GeneralStateTestsFiller/stCallDelegateCodesCallCodeHomestead appears to be unused!
WARNING: Test folder /root/tests/src/GeneralStateTestsFiller/stCallDelegateCodesHomestead appears to be unused!
WARNING: Test folder /root/tests/src/GeneralStateTestsFiller/stChainId appears to be unused!
WARNING: Test folder /root/tests/src/GeneralStateTestsFiller/stCodeCopyTest appears to be unused!
WARNING: Test folder /root/tests/src/GeneralStateTestsFiller/stCodeSizeLimit appears to be unused!
WARNING: Test folder /root/tests/src/GeneralStateTestsFiller/stCreate2 appears to be unused!
WARNING: Test folder /root/tests/src/GeneralStateTestsFiller/stCreateTest appears to be unused!
WARNING: Test folder /root/tests/src/GeneralStateTestsFiller/stDelegatecallTestHomestead appears to be unused!
WARNING: Test folder /root/tests/src/GeneralStateTestsFiller/stEIP150Specific appears to be unused!
WARNING: Test folder /root/tests/src/GeneralStateTestsFiller/stEIP150singleCodeGasPrices appears to be unused!
WARNING: Test folder /root/tests/src/GeneralStateTestsFiller/stEIP1559 appears to be unused!
WARNING: Test folder /root/tests/src/GeneralStateTestsFiller/stEIP158Specific appears to be unused!
WARNING: Test folder /root/tests/src/GeneralStateTestsFiller/stEIP2930 appears to be unused!
WARNING: Test folder /root/tests/src/GeneralStateTestsFiller/stEIP3607 appears to be unused!
WARNING: Test folder /root/tests/src/GeneralStateTestsFiller/stExample appears to be unused!
WARNING: Test folder /root/tests/src/GeneralStateTestsFiller/stExpectSection appears to be unused!
WARNING: Test folder /root/tests/src/GeneralStateTestsFiller/stExtCodeHash appears to be unused!
WARNING: Test folder /root/tests/src/GeneralStateTestsFiller/stHomesteadSpecific appears to be unused!
WARNING: Test folder /root/tests/src/GeneralStateTestsFiller/stInitCodeTest appears to be unused!
WARNING: Test folder /root/tests/src/GeneralStateTestsFiller/stLogTests appears to be unused!
WARNING: Test folder /root/tests/src/GeneralStateTestsFiller/stMemExpandingEIP150Calls appears to be unused!
WARNING: Test folder /root/tests/src/GeneralStateTestsFiller/stMemoryStressTest appears to be unused!
WARNING: Test folder /root/tests/src/GeneralStateTestsFiller/stMemoryTest appears to be unused!
WARNING: Test folder /root/tests/src/GeneralStateTestsFiller/stNonZeroCallsTest appears to be unused!
WARNING: Test folder /root/tests/src/GeneralStateTestsFiller/stPreCompiledContracts appears to be unused!
WARNING: Test folder /root/tests/src/GeneralStateTestsFiller/stPreCompiledContracts2 appears to be unused!
WARNING: Test folder /root/tests/src/GeneralStateTestsFiller/stQuadraticComplexityTest appears to be unused!
WARNING: Test folder /root/tests/src/GeneralStateTestsFiller/stRandom appears to be unused!
WARNING: Test folder /root/tests/src/GeneralStateTestsFiller/stRandom2 appears to be unused!
WARNING: Test folder /root/tests/src/GeneralStateTestsFiller/stRecursiveCreate appears to be unused!
WARNING: Test folder /root/tests/src/GeneralStateTestsFiller/stRefundTest appears to be unused!
WARNING: Test folder /root/tests/src/GeneralStateTestsFiller/stReturnDataTest appears to be unused!
WARNING: Test folder /root/tests/src/GeneralStateTestsFiller/stRevertTest appears to be unused!
WARNING: Test folder /root/tests/src/GeneralStateTestsFiller/stSLoadTest appears to be unused!
WARNING: Test folder /root/tests/src/GeneralStateTestsFiller/stSStoreTest appears to be unused!
WARNING: Test folder /root/tests/src/GeneralStateTestsFiller/stSelfBalance appears to be unused!
WARNING: Test folder /root/tests/src/GeneralStateTestsFiller/stShift appears to be unused!
WARNING: Test folder /root/tests/src/GeneralStateTestsFiller/stSolidityTest appears to be unused!
WARNING: Test folder /root/tests/src/GeneralStateTestsFiller/stSpecialTest appears to be unused!
WARNING: Test folder /root/tests/src/GeneralStateTestsFiller/stStackTests appears to be unused!
WARNING: Test folder /root/tests/src/GeneralStateTestsFiller/stStaticCall appears to be unused!
WARNING: Test folder /root/tests/src/GeneralStateTestsFiller/stStaticFlagEnabled appears to be unused!
WARNING: Test folder /root/tests/src/GeneralStateTestsFiller/stSystemOperationsTest appears to be unused!
WARNING: Test folder /root/tests/src/GeneralStateTestsFiller/stTimeConsuming appears to be unused!
WARNING: Test folder /root/tests/src/GeneralStateTestsFiller/stTransactionTest appears to be unused!
WARNING: Test folder /root/tests/src/GeneralStateTestsFiller/stTransitionTest appears to be unused!
WARNING: Test folder /root/tests/src/GeneralStateTestsFiller/stWalletTest appears to be unused!
WARNING: Test folder /root/tests/src/GeneralStateTestsFiller/stZeroCallsRevert appears to be unused!
WARNING: Test folder /root/tests/src/GeneralStateTestsFiller/stZeroCallsTest appears to be unused!
WARNING: Test folder /root/tests/src/GeneralStateTestsFiller/stZeroKnowledge appears to be unused!
WARNING: Test folder /root/tests/src/GeneralStateTestsFiller/stZeroKnowledge2 appears to be unused!
*** Total Tests Run: 232

--------
*** TOTAL ERRORS DETECTED: 3 errors during all test execution!
--------
info: (stCallCodes/touchAndGo, fork: Berlin, TrInfo: d: 0, g: 0, v: 0)
Skipping stQuadraticComplexityTest because --all option is not specified.
Skipping stTimeConsuming because --all option is not specified.

*** 1 failure is detected in the test module "EthereumTests"
meowsbits commented 2 years ago

I've resolved this by fixing the solc warning:

WARNING: Error getting solc Version

I ran:

apt-get install wget && wget https://github.com/ethereum/solidity/releases/download/v0.8.5/solc-static-linux \
   && cp solc-static-linux /bin/solc \
   && chmod +x /bin/solc

And now the issue is gone :heavy_check_mark:

@winsvega Maybe this WARNING should be an ERROR if solc is a firm dependency?