Closed jkibele closed 6 years ago
Here's one little corner of the land network:
That's a lot of edges.
Multiprocessing was a serious pain in the ass, but it's working now. On a single processor, it took over two hours. On my MacBook pro running on six processors, it took 16 minutes. Running on Aurora with 15 processors, it took 2 minutes. Yay!
Without parallel processing, it took 2 hours and 20 minutes to generate a graph for ocean distances around Nunivak Island. Admittedly, my computer went to sleep during part of that, but it's way to slow regardless. Especially when you consider that that one island is a tiny fraction of the nodes that will need to be used.
We need to consider two options for speeding things up:
Simplify the land graph. This would reduce the number of nodes we need to calculate for. However, we could run into problems if the simplification drops nodes that represent river mouths. This might make those river mouths end up on land. ...and will likely make them not line up perfectly with the actual river mouths. The difference would be negligible in terms of distance, but it would introduce problems with finding paths out of rivers. Possible solutions: