search

CronCats / croncat-indexer

Listen to the chain, get stats about croncat!
0 stars 0 forks source link

[FEATURE]: Batch historical queries and adopt a slower ingestion time #9

Closed SeedyROM closed 9 months ago

SeedyROM commented 1 year ago

Our old way of spamming the RPCs was making our providers not happy and they probably implemented some kind of load balancing.

Now we get historical batches in chunks and wait between each request to keep the providers happy!

Can other people try this out locally?

SeedyROM commented 1 year ago

After some thinking the last real improvement we can make is instead of sending a tx_search query for each block we use a range for that as well. Not sure if this will help, but it's an idea!