chairemobilite / transition

Transition is a modern new approach to transit planning. It's a web application to model, simulate and plan public transit and alternative transportation.
http://transition.city
MIT License
21 stars 13 forks source link

Parallelize preparation of OSRM data #58

Open greenscientist opened 3 years ago

greenscientist commented 3 years ago

In the prepareOsmNetworkData, we generate the OSRM data for each mode in sequence. It would go faster if this was done in sequence

This would easily be done by move some of the code in an async function and calling all of them and waiting for all of them at the end. It would also be beneficial to log the output of the operations somewhere, in a file or otherwise.

kaligrafy commented 3 years ago

osrm is already running in parallel, so I don't see any benefits here.

kaligrafy commented 3 years ago

I get 2400% CPU on osrm-extract and osrm-contract on my 12-core 24 threads machine

greenscientist commented 3 years ago

interesting,

But still, if you can get data on running 2 osrm-extract in parallel vs in serie and see what are the total time for both

On Tue, Apr 20, 2021 at 5:22 PM Pierre-Léo Bourbonnais < @.***> wrote:

I get 2400% CPU on osrm-extract and osrm-contract on my 12-core 24 threads machine

— You are receiving this because you authored the thread. Reply to this email directly, view it on GitHub https://github.com/kaligrafy/transition/issues/736#issuecomment-823608066, or unsubscribe https://github.com/notifications/unsubscribe-auth/AABDR5L6Z5NDTJAVGT2HXB3TJXWAXANCNFSM43JBJ7KA .