1Hive / apiary

Aragon DAO explorer
https://apiary.1hive.org
GNU General Public License v3.0
25 stars 16 forks source link

Use cursors instead of loading entire result set into memory #178

Closed onbjerg closed 4 years ago

onbjerg commented 4 years ago

Right now we do a single query to get every transaction and log in a block and load this directly into memory. However, some blocks contain very large transactions with a large number of logs, which might cause the worker to run out of memory.

Instead, we should use a cursor and iterate over rows 1-by-1.

Documentation

onbjerg commented 4 years ago

No longer relevant since we're moving to The Graph (#200).