feat: make metastorage platform agnostic & configurable - Githubissues

coinbase / chainstorage

The File System For a Multi-Blockchain World

https://time-wilderness-a70.notion.site/ChainStorage-5c173d1cafd842ceb9e38c26bfbd6265?pvs=4

Apache License 2.0

69 stars 24 forks source link

feat: make metastorage platform agnostic & configurable #48

Closed bestmike007 closed 8 months ago

bestmike007 commented 8 months ago

What changed? Why?

Add a MetaStorageType config
Make MetaStorage interface platform agnostic, i.e. EventDDBEntry -> EventEntry, and add internal conversion functions
Make EventsToChainAdaptor platform agnostic
Turn the DynamoDB implementation into a sub package
Use named factory to create MetaStorage instance according to config

How did you test the change?

GitHub Actions
Run backfill (go run ./cmd/admin backfill --blockchain bsc --network mainnet --env local --start-height 32306000 --end-height 32306010) with localstack
Run backfill workflow: go run ./cmd/admin workflow start --workflow backfiller --input '{"StartHeight": 18398700, "EndHeight": 18398710, "NumConcurrentExtractors": 5}' --blockchain ethereum --network mainnet --env local

bestmike007 commented 8 months ago

Let me break this down.

bestmike007 commented 8 months ago

Replaced by linked PRs above.