Explore speeding-up simplify network target

nptscot / npt

Data processing code, also use this repo for issue tracking for the Network Planning Tool. See https://nptscot.github.io for development version

https://www.npt.scot/

GNU Affero General Public License v3.0

5 stars 0 forks source link

Explore speeding-up simplify network target #419

Closed Robinlovelace closed 3 weeks ago

Robinlovelace commented 3 months ago

As described here this seems to be one of the most time-consuming parts of the build process: https://github.com/nptscot/npt/pull/414#issuecomment-1987356025

Possible steps:

[ ] Find out which part of it is slowest
[ ] Explore alternative ways (it maybe that the nacsent rnetmatch package will help)
[ ] Speed it up if worthwhile

Robinlovelace commented 3 months ago

And amazingly for Glasgow and Strathclyde the simplify network stage took ~75% of the time for the network with 1000 routes (still a test size):

● built target simplified_network [1.566 hours]
▶ start target pmtiles_rnet_simplified
● built target pmtiles_rnet_simplified [0.015 seconds]
▶ end pipeline [1.969 hours]