EntropicLabs / tendermint-indexer

TypeScript framework for building Tendermint RPC node data indexers
0 stars 0 forks source link

Add worker_threads support to backfilling #1

Open ashayp22 opened 3 months ago

ashayp22 commented 3 months ago

Bun v1.1.13 added more support for worker_threads, which should now let us use worker_threads for parallelizing the unstake event backfilling.

Update

TODO

ashayp22 commented 2 months ago

11 sped up backfilling with async/await. Threads will be helpful for computationally intense indexing, but no such indexers exist as of right now (both unstake-indexer and quark-indexer are I/O intensive). We should look into this enhancement based on if computationally intense indexers are created.