search

matrix-org / rust-synapse-compress-state

A tool to compress some state in a Synapse instance's database
https://pypi.org/project/synapse-auto-compressor/
Apache License 2.0
143 stars 33 forks source link

Add ability to write to the database directly during the run. #20

Open erikjohnston opened 4 years ago

erikjohnston commented 4 years ago

This tool has now been run quite a lot without issues, so hopefully its safe enough that we can write directly to the database during the run rather than keeping everything in memory.

This would also allow us to not keep all the state in memory for the entire set of target state.

TheDiscordian commented 3 years ago

Maybe the ability to load a list of rooms would be useful too, coupled with this it shouldn't cause too many problems assuming #7 is only caused by very small rooms.

Edit: Actually #21 maybe indicate #7 is a big enough issue to warrant not writing to DB, needs more investigation though.