Update geth and implement transaction batching.

cerc-io / ipld-eth-state-snapshot

Read-only mirror of https://git.vdb.to/cerc-io/ipld-eth-state-snapshot (Tool for inserting the entire state and storage tries into PG-IPFS)

https://git.vdb.to/cerc-io/ipld-eth-state-snapshot

GNU Affero General Public License v3.0

8 stars 4 forks source link

Update geth and implement transaction batching. #11

Closed arijitAD closed 2 years ago

arijitAD commented 2 years ago

fixes:https://github.com/vulcanize/eth-pg-ipfs-state-snapshot/issues/10

Old Code: https://github.com/vulcanize/eth-pg-ipfs-state-snapshot/pull/13 Benchmark Result:

Main-net LevelDB
Block number: 100000
Old code: 48 min
New code: 6 min
~7x Improvement

Database(Row count):

state_cids = 21364
storage_cids = 4159
blocks = 25461
header_cid = 1

Old Code: Screenshot_2021-12-20_at_6 40 39_PM

New Code: Screenshot_2021-12-20_at_7 18 38_PM

i-norden commented 2 years ago

Oh and just to be clear, this doesn't actually satisfy all of #10 as this works with the go-ethereum v1.10.11-statediff-0.0.27 and not the new db schema on postgres_refactor. But this is absolutely needed as well, we want an updated version of this to work with the last stable state of things that still uses the old db schema (since that is what Ashwin and his watchers are currently using).

i-norden commented 2 years ago

I made a new issue (#11) and edited #10 to help delineate things and so we have something to close when this is merged :)