Improve indexing performance - Githubissues

subconsciousnetwork / subconscious

Apache License 2.0

6 stars 0 forks source link

Improve indexing performance #1123

Closed bfollington closed 4 months ago

bfollington commented 4 months ago

Batch reads and database calls in tight loops
Reduce re-parsing cost in MemoRecord init
Index peers in TaskGroup
Reduce re-parsing again
Adjust task priority

Speeds up indexing between 4x and 6x.

Before

After