search

omniscale / imposm3

Imposm imports OpenStreetMap data into PostGIS
http://imposm.org/docs/imposm3/latest/
Apache License 2.0
711 stars 156 forks source link

Replace LevelDB with SSD-friendly alternative #167

Closed JanJakes closed 6 years ago

JanJakes commented 6 years ago

LevelDB "was designed specifically for rotating disks" but today SSDs are everywhere. There is a PR with RocksDB support but that might be outdated as well today.

Now there are highly SSD optimized key-value DBs (like https://github.com/dgraph-io/badger, which is written in GO).

Are there any plans to try to replace LevelDB with a more up-to-date alternative? On modern NVMe SSD I see much lower IO throughput than the disk is capable of.

olt commented 6 years ago

The next LevelDB version (1.21) contains improvements. The Imposm GitHub releases are already build with this (LEVELDB_POST_121=1 make).

The improvements with RocksDB were mixed (see #138) and alternatives like Badger have other drawbacks. LevelDB is rock stable and fast enough for us. Sure there is always room for improvement, but right now there is no apparent reason for us to spend unpaid time on a replacement.