search

coinbase / chainstorage

The File System For a Multi-Blockchain World
https://time-wilderness-a70.notion.site/ChainStorage-5c173d1cafd842ceb9e38c26bfbd6265?pvs=4
Apache License 2.0
68 stars 24 forks source link

Modernized ChainStorage Sync: Enable Chainstorage consuming ChainNode/ChainStorage block as backfill source #66

Open leozc opened 7 months ago

leozc commented 7 months ago
  1. ChainNode as data source: Unlike normal node providers, Chainnode uses header to capture security token (yes, safer!) but currently Chainstorage doesn't seem to support this way to authenticate with a block provider.
  2. ChainStorage as data source: Enable ChainStorage use another ChainStorage Blocks to sync can be 100x of the syncing performance (Assume 100 trx for each block)

Cc @jiezhang

P1

bestmike007 commented 4 months ago

Replicator workflow POC: backfilling from another chainstorage: #91

bestmike007 commented 4 months ago

Improve replicator workflow by introducing mini batches and continue workflow as new to prevent timeout: https://github.com/coinbase/chainstorage/pull/94