mongo: add --batch-secs flag to configure the rate of database writes

apibara / dna

Apibara is the fastest platform to build production-grade indexers that connect onchain data to web2 services.

https://www.apibara.com/

Apache License 2.0

166 stars 26 forks source link

Closed bigherc18 closed 3 months ago

bigherc18 commented 4 months ago

mongo: add --batch-secs flag to configure the rate of database writes

mongo: add tests for batch mode

sink: WIP: refactoring batching logic

sink: polishing batching logic

sink: use the full name for seconds to avoid double guessing

sink: ignore integration test

sink-parquet: remove logging in handle_data

We already have logs for each batch in sink-common

Co-authored-by: Francesco Ceccon francesco@ceccon.me

bigherc18 commented 4 months ago

This stack of pull requests is managed by Graphite. Learn more about stacking.

Join @bigherc18 and the rest of your teammates on Graphite

fracek commented 3 months ago

This changes were merged as part of another PR.