ClickHouse / CryptoHouse

Artifacts including queries and materialized views used for CryptoHouse
https://crypto.clickhouse.com
Apache License 2.0
35 stars 3 forks source link

Enhance CryptoHouse with Multi-Blockchain Queries Using Blockchair Datasets #8

Open linuxion opened 2 months ago

linuxion commented 2 months ago

We at Blockchair use ClickHouse since our foundation in 2016. It is an absolute unit for web3 analytics which made our API functionally superior on the market. It would be great to see more blockchains in CryptoHouse.

Describe the solution you'd like Integrating Blockchair and 3xpl datasets, which represent all events that have happened across 43 blockchains, could be beneficial for web3 analytics who use CryptoHouse. This integration would involve:

Adding new queries to the queries.json file for these new datasets. For instance, queries could be designed to analyze transaction volumes, average fees, mining stats and patterns across different blockchains, or to track token movements across chains (bridging/rollups), providing users with insights into cross-chain liquidity flows.

Developing new materialized views that pre-process and aggregate Blockchair data for high-demand queries, enhancing performance and user experience by speeding up data retrieval processes.

Describe alternatives you've considered As an alternative to a full integration, we could implement a phased approach where only a subset of Blockchair's datasets for major blockchains is initially integrated to assess user engagement and technical stability. Or we can provide data for, let's say, last month, last 90 days or 1 year.

СС @alexey-milovidov @Har01d

gingerwizard commented 1 month ago

Hi @linuxion Thanks for this offer of more data. Currently we have datasets planned that Goldsky have agreed to provide - solana (instructions) and base are now available and we have a roadmap of datasets to add. Its a non trivial effort for us to partner with a data provider and provide write access - so there needs to be a dataset we can't source from our existing partnerships. Do you have a list of the chains you would be interested in providing? we can evaluate this against our roadmap and determine if the effort is worthwhile.