search

LukePrior / nbn-upgrade-map

Interactive map showing premises eligible for the NBN FTTP upgrade program.
https://lukeprior.github.io/nbn-upgrade-map/
MIT License
101 stars 11 forks source link

Giant Suburbs Failing #245

Open LukePrior opened 10 months ago

LukePrior commented 10 months ago

The 6-hour runtime limit is being exceeded will need to investigate potential solutions.

https://github.com/LukePrior/nbn-upgrade-map/actions/runs/6013018009

lyricnz commented 10 months ago

Did something get stuck? This suburb has been processed before, and was only running for 1hr (according to logs)

2023-08-29 13:37:27,871 INFO MainThread Checking for externally updated geojson results...
..
2023-08-29 14:16:28,117 INFO MainThread Writing results to results/NSW/lillian-rock.geojson
2023-08-29 14:16:28,667 INFO MainThread Updating progress.json
2023-08-29 14:16:28,669 INFO MainThread Processing Sydney, NSW
2023-08-29 14:16:28,670 INFO MainThread Time elapsed: 0:38:58/1:00:00
2023-08-29 14:16:28,670 INFO MainThread Fetching all addresses for Sydney, NSW
2023-08-29 14:16:28,988 INFO MainThread Fetched 41612 addresses from database
2023-08-29 14:16:29,159 INFO MainThread Loaded 41610 addresses from output file
2023-08-29 14:16:29,171 INFO MainThread Submitting 41612 requests to add NBNco data...
...
2023-08-29 14:32:14,111 INFO nbn_2 Completed 41272 requests
2023-08-29 14:32:16,116 INFO nbn_1 Completed 41352 requests
2023-08-29 14:32:29,325 WARNING nbn_3 Error fetching NBN data for UNIT 905, 160 KING STREET SYDNEY 2000: ('Connection aborted.', RemoteDisconnected('Remote end closed connection without response'))
2023-08-29 14:32:31,786 INFO nbn_3 Completed 41532 requests
2023-08-29 14:36:43,423 WARNING nbn_0 Error fetching NBN data for UNIT 95, 3 MACQUARIE STREET SYDNEY 2000: ('Connection aborted.', RemoteDisconnected('Remote end closed connection without response'))
2023-08-29 14:36:49,541 INFO nbn_0 Completed 41572 requests
Error: The operation was canceled.
lyricnz commented 10 months ago

And ran successfully the next time https://github.com/LukePrior/nbn-upgrade-map/actions/runs/6019795004/job/16330128286

LukePrior commented 10 months ago

Interesting, maybe it was something else then.

LukePrior commented 9 months ago

similar issue i think here: https://github.com/LukePrior/nbn-upgrade-map/actions/runs/6160968702

lyricnz commented 9 months ago

Yeah. Looks like it was running fine, then "got stuck" and then timed out ~5.5 hours later. Race condition somewhere causing a deadlock?

lyricnz commented 8 months ago

Happens every week or two. Example https://github.com/LukePrior/nbn-upgrade-map/actions/runs/6594758905