TacticalMetaphysics / LiSE

Rules-based engine for life sims, with time travel
GNU Affero General Public License v3.0
116 stars 9 forks source link

More space-efficient storage #128

Open clayote opened 3 weeks ago

clayote commented 3 weeks ago

Sims that have many changes will have large databases. However, most of the database is highly repetitive, leading it to compress extremely well. This is just how databases normally operate. Still, if LiSE is to be used on low-spec machines, it would be impolite to consume more space than necessary.

A file-based data store using the Parquet format might do the trick.

clayote commented 3 weeks ago

It looks like ParquetDB will do what I want, but probably isn't mature enough to use as a dependency yet.