Reingest tables - Githubissues

samcm commented 3 months ago

Now that most of the Xatu clickhouse tables are using merge trees, we can reupload the tables to S3 to automatically have duplicates removed.

Progress:

[x] beacon_api_eth_v1_beacon_committee
[x] beacon_api_eth_v1_events_blob_sidecar
[x] beacon_api_eth_v1_events_block
[x] beacon_api_eth_v1_events_chain_reorg
[x] beacon_api_eth_v1_events_contribution_and_proof
[x] beacon_api_eth_v1_events_finalized_checkpoint
[x] beacon_api_eth_v1_events_head
[x] beacon_api_eth_v1_events_voluntary_exit
[x] beacon_api_eth_v1_proposer_duty
[x] beacon_api_eth_v1_validator_attestation_data
[x] beacon_api_eth_v2_beacon_block
[x] mempool_transaction

samcm commented 2 months ago

beacon_api_eth_v1_events_finalized_checkpoint on all networks has been deleted and is in the process of reuploading

samcm commented 2 months ago

beacon_api_eth_v1_events_blob_sidecar on all networks has been deleted and is in the process of reuploading

samcm commented 2 months ago

beacon_api_eth_v1_events_block on all networks has been deleted and is in the process of reuploading

samcm commented 2 months ago

beacon_api_eth_v1_events_finalized_checkpoint has completed it's upload.

samcm commented 2 months ago

beacon_api_eth_v1_events_chain_reorg on all networks has been deleted and is in the process of reuploading

samcm commented 2 months ago

beacon_api_eth_v1_events_blob_sidecar has completed it's upload.

samcm commented 2 months ago

mempool_transaction on all networks has been deleted and is in the process of reuploading

samcm commented 2 months ago

beacon_api_eth_v1_events_chain_reorg has completed its upload.

samcm commented 2 months ago

beacon_api_eth_v1_events_block has completed its upload.

samcm commented 2 months ago

beacon_api_eth_v1_events_contribution_and_proof has been deleted on all networks and is in the process of reuploading.

samcm commented 2 months ago

beacon_api_eth_v1_events_head has been deleted on all networks and is in the process of reuploading.

samcm commented 2 months ago

beacon_api_eth_v1_events_voluntary_exit has been deleted on all networks and is in the process of reuploading.

samcm commented 2 months ago

beacon_api_eth_v1_proposer_duty has been deleted on all networks and is in the process of reuploading.

samcm commented 2 months ago

beacon_api_eth_v1_validator_attestation_data has been deleted on all networks and is in the process of reuploading.

samcm commented 2 months ago

beacon_api_eth_v1_beacon_committee has been deleted on all networks and is in the process of reuploading.

samcm commented 2 months ago

beacon_api_eth_v1_events_voluntary_exit has completed its upload.

samcm commented 2 months ago

beacon_api_eth_v1_events_contribution_and_proof has completed its upload.

samcm commented 2 months ago

beacon_api_eth_v1_proposer_duty has completed its upload.

samcm commented 2 months ago

beacon_api_eth_v2_beacon_block has been deleted on all networks and is in the process of reuploading.

samcm commented 2 months ago

beacon_api_eth_v1_validator_attestation_data has completed its upload.

samcm commented 2 months ago

beacon_api_eth_v2_beacon_block has completed its upload.

samcm commented 2 months ago

mempool_transaction has completed its upload.

samcm commented 2 months ago

beacon_api_eth_v1_beacon_committee has completed its upload.

ethpandaops / xatu-data

Reingest tables #14