sarob
commented
1 year ago davidgasquez — 04/12/2023 2:19 AM Very silly and small but got me excited: yesterday I was able to build a small dbt model on top of the AWS crypto data in my Datadex project. That means anyone can run models¹ (like the ones in Dune spellbook) using public chain data². Thanks to modern tooling, the model I wrote didn't had to scan all data and was able to finish in... 4s! This might be a great start while the Trueblocks pipeline comes along. In the ideal world, a TrueBlocks-like pipeline running in Bacalhau-like network produces the chain data and puts it in IPFS. People can query it from their laptops or even from inside Bacalhau-like to push the data back to IPFS.
¹ https://github.com/davidgasquez/datadex/blob/main/dbt/models/ethereum_daily_blocks.sql ² https://github.com/davidgasquez/datadex/blob/main/dbt/models/sources.yml#L16-L20
Wrote this tweet in case you want to share: https://twitter.com/davidgasquez/status/1646080447808520193
see discord discussion at https://discord.com/channels/1037443230993743902/1065417716942504068/1095750644490567861
Node Storage - Storj vs. alternatives Indexing - TrueBlock or other ETL? Other -
potentially each of these could have a standard structure that we then source from the community
for eg: