nismod / transport

NISMOD v2 Transport Model is a national-scale (Great Britain) transport model developed to support policy making regarding the future infrastructure
http://www.itrc.org.uk
MIT License
9 stars 3 forks source link

Reduce high memory usage #34

Open tomalrussell opened 3 years ago

tomalrussell commented 3 years ago

A simulation run of the full GB road model uses considerable RAM (up to ~80 or 120 GB).

This is largely due to holding pre-computed alternative route options for all origin-destination pairs in memory.

Could consider a file-based solution (leveldb, SQLite or similar?).

Though this would likely have some effect on simulation time, it would make the model much easier to run on any machine that's not specifically a "high-memory" VM/node.