How can we estimate the size ./pgsql_tmp will have on importing from a OSM postgres db ?

komoot / photon

an open source geocoder for openstreetmap data

Apache License 2.0

1.83k stars 278 forks source link

How can we estimate the size ./pgsql_tmp will have on importing from a OSM postgres db ? #724

Closed stouch closed 1 year ago

stouch commented 1 year ago

I am indexing Photon data from a nominatim postgres db, and I have some storage constraints (postgres db, and photon data, have their own storage volumes). I noticed that on java -jar photon-*.jar -nominatim-import, the postgres tmp file becomes quickly huge, so I'd like to estimate how much size it's gonna take.

Thanks,

Regards,

stouch commented 1 year ago

Ok so, for this setup (12 west-european + 3 north-african countries, in 8 languages), after a nominatim install without updates (multiple --osm-file) and with a flatnode file configured, I've got :

80G   ./nominatim-project/flatnode
275G  ./postgres-data/main

with a : 27G ./postgres-data/main/base/pgsql_tmp

so about ~10% of the total postgresql db

Do you think it's what I should expect ?