matrix-org / rust-synapse-compress-state

A tool to compress some state in a Synapse instance's database
https://pypi.org/project/synapse-auto-compressor/
Apache License 2.0
143 stars 33 forks source link

Allow running incrementally. #18

Closed erikjohnston closed 4 years ago

erikjohnston commented 4 years ago

Currently each run we start from the beginning of the room, which means that if run periodically a bunch of wasted effort occurs. This also means that we can't run against very large room without running out of memory.

We should add a way of setting the starting point (via event ID or stream ordering or something).

erikjohnston commented 4 years ago

Apparently even when there's only 12 issues I still manage to make duplicates :facepalm: