ancil-t
commented
2 years ago I even tried running the export_all.sh script by running the following
bash export_all.sh -s 9733023 -e 9733123 -b 10000 -p file://$HOME/.ethereum/geth.ipc -o outputI end up getting the same error
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/usr/lib/python3.10/runpy.py", line 196, in _run_module_as_main
return _run_code(code, main_globals, None,
File "/usr/lib/python3.10/runpy.py", line 86, in _run_code
exec(code, run_globals)
File "/home/ubuntu/data/ethereum-etl/ethereumetl/__main__.py", line 26, in <module>
cli()
File "/home/ubuntu/.local/lib/python3.10/site-packages/click/core.py", line 1128, in __call__
return self.main(*args, **kwargs)
File "/home/ubuntu/.local/lib/python3.10/site-packages/click/core.py", line 1053, in main
rv = self.invoke(ctx)
File "/home/ubuntu/.local/lib/python3.10/site-packages/click/core.py", line 1659, in invoke
return _process_result(sub_ctx.command.invoke(sub_ctx))
File "/home/ubuntu/.local/lib/python3.10/site-packages/click/core.py", line 1395, in invoke
return ctx.invoke(self.callback, **ctx.params)
File "/home/ubuntu/.local/lib/python3.10/site-packages/click/core.py", line 754, in invoke
return __callback(*args, **kwargs)
File "/home/ubuntu/data/ethereum-etl/ethereumetl/cli/export_receipts_and_logs.py", line 65, in export_receipts_and_logs
job.run()
File "/home/ubuntu/data/ethereum-etl/blockchainetl/jobs/base_job.py", line 30, in run
self._end()
File "/home/ubuntu/data/ethereum-etl/ethereumetl/jobs/export_receipts_job.py", line 81, in _end
self.batch_work_executor.shutdown()
File "/home/ubuntu/data/ethereum-etl/ethereumetl/executors/batch_work_executor.py", line 97, in shutdown
self.executor.shutdown()
File "/home/ubuntu/data/ethereum-etl/ethereumetl/executors/fail_safe_executor.py", line 39, in shutdown
self._check_completed_futures()
File "/home/ubuntu/data/ethereum-etl/ethereumetl/executors/fail_safe_executor.py", line 47, in _check_completed_futures
future.result()
File "/usr/lib/python3.10/concurrent/futures/_base.py", line 439, in result
return self.__get_result()
File "/usr/lib/python3.10/concurrent/futures/_base.py", line 391, in __get_result
raise self._exception
File "/usr/lib/python3.10/concurrent/futures/thread.py", line 58, in run
result = self.fn(*self.args, **self.kwargs)
File "/home/ubuntu/data/ethereum-etl/ethereumetl/executors/batch_work_executor.py", line 70, in _fail_safe_execute
execute_with_retries(work_handler, [item],
File "/home/ubuntu/data/ethereum-etl/ethereumetl/executors/batch_work_executor.py", line 104, in execute_with_retries
return func(*args)
File "/home/ubuntu/data/ethereum-etl/ethereumetl/jobs/export_receipts_job.py", line 69, in _export_receipts
receipts = [self.receipt_mapper.json_dict_to_receipt(result) for result in results]
File "/home/ubuntu/data/ethereum-etl/ethereumetl/jobs/export_receipts_job.py", line 69, in <listcomp>
receipts = [self.receipt_mapper.json_dict_to_receipt(result) for result in results]
File "/home/ubuntu/data/ethereum-etl/ethereumetl/utils.py", line 71, in rpc_response_batch_to_results
yield rpc_response_to_result(response_item)
File "/home/ubuntu/data/ethereum-etl/ethereumetl/utils.py", line 82, in rpc_response_to_result
raise RetriableValueError(error_message)
ethereumetl.misc.retriable_value_error.RetriableValueError: result is None in response {'jsonrpc': '2.0', 'id': 0, 'result': None}. Make sure Ethereum node is synced.
2022-06-30 03:43:30 An error occurred. Quitting.For some context, when I run the following, it exports the tx receipt and logs fine:
bash export_all.sh -s 14000000 -e 14000050 -b 1000000 -p file://$HOME/.ethereum/geth.ipc -o output
0xstochastic
akuehlka
abhishektvz
robi00
megalepozy
boxhock
Thank you for this excellent package btw! I was wondering whether anyone can help me with this issue
Description
The
export_receipts_and_logscommand fails when it encounters a tx hash that has no tx receipt or event logs.Verification
I've verified this by running the command against two files:
tx_hash_with_logs.txt) with just0x37c5c1f28fca1638aac3ec7c0c1b5c1ebf8df18cd979e949d38d1627b0316610. This tx has does have a tx receipt and logs.tx_hash_no_logs.txt) with just0x5c504ed432cb51138bcf09aa5e8a410dd4a1e204ef84bfed1be16dfba1b22060. This tx hash contains no tx receipt and no logs.1works as expected but2emits some errors after several retries before the process tops.I've also made RPC calls
eth.getTransactionReceiptfrom the geth console with both tx hashes. One returnsnulland the other returns the tx receipt with logs. So we know this isn't a case of geth not being synced.Expected
I expect
export_receipts_and_logsto ignore tx hashes that return null and move on to the next tx hash.Actual
What happens currently is it retries 4 times before the process stops.
Versions
Thank you