MetricsDAO / harmony_dbt

DBT Project for the Harmony Blockchain
12 stars 8 forks source link

Add tokenprices tables #46

Closed antonyip closed 2 years ago

antonyip commented 2 years ago

This will ease the load on the snowflake database

antonyip commented 2 years ago

LGTM after nits Curious why you're breaking all token prices into separate tables instead of combining into one since the logics are quite similar but from different logs as i can tell

Plan is to have per minute price data ingested in the future.. Having it all in 1 table will make it heavy on the database. Also, the general structure is the same, but the details are quite hard to generalize (different decimals for tokens , different formulas for different token pairs, sometimes its token0/token1, sometimes its token1/token0 ) and I feel this will cause quite a heavy compute in my 20 dfk_tables.