[indexing] Introduce changesets per parsed block

hypercerts-org / hypercerts-indexer

Indexing service for hypercerts metadata

2 stars 0 forks source link

[indexing] Introduce changesets per parsed block #180

Closed bitbeckers closed 3 weeks ago

bitbeckers commented 1 month ago

To reduce the I/O between services, improve the parsing of blocks by creating a changeset per block and writing that as a single (batched) transaction into supabase.

Potential solution:

Kysely for DB transactions: https://kysely.dev/docs/examples/transactions/simple-transaction
Kysely supabase: https://github.com/kysely-org/kysely-supabase

bitbeckers commented 3 weeks ago

In #191