Import labeling into warehouse

Octan-Labs / pipeline

1 stars 0 forks source link

Import labeling into warehouse #150

Closed trmaphi closed 1 year ago

trmaphi commented 1 year ago

[x] Schema confirm
[x] Setup db connection
[x] Import with dag
[x] prefix with label_
[x] write docs
- [x] how to get data how to map api table with clickhouse table
- [x] how to run

trmaphi commented 1 year ago

done eth, wait for bsc

noobmdev commented 1 year ago

Label table schema

CREATE TABLE IF NOT EXISTS label_bnb_contract
(
    address FixedString(42),
    identity Nullable(String),
    category Nullable(String),
    version Nullable(String),
    safety Nullable(String),  
    project Nullable(String)
)
ENGINE = ReplicatedReplacingMergeTree('/clickhouse/tables/{uuid}/{shard}', '{replica}')
ORDER BY (address)
SETTINGS index_granularity = 8192, storage_policy = 's3';