search

itinero / reminiscence

A library for cross-platform memory mapping.
MIT License
9 stars 6 forks source link

AddContracted extremy slow #26

Closed TomQv closed 2 years ago

TomQv commented 2 years ago

We are busy rebuilding the routerdbs for many countries of the world. Its the first time since a couple of years so I don't remember anymore, how it went that time.

Anyway, now its Itinero 1.6.0-pre032, Reminiscence 1.3.0. with a Windows App x64.

For example germany-latest.osm.pbf. routerDb.LoadOsmData() is an hour, thats acceptable. Then routerDb.AddContracted() with standard-profiles Car, Bicycle and Walking. 12-15h each. Will take us month to compile all the countries.

The machine is a I5 3.3GHz with 32G ram. CPU load is around 40% and memory consumption ca 20GB. Network load is 0% so I believe, its ok, if the PBF is on a NAS? Everything is done in Memory?

Maybe we are doing something wrong or missing something? Would be great if there is a trick to speed up.

TomQv commented 2 years ago

Update:

12h is only AddContracted Car. AddContracted Pedestrian is currently still running, already 48h....

Please, what is wrong here?

TomQv commented 2 years ago

sorry, was posted by mistake in reminiscence moved to here https://github.com/itinero/routing/issues/346