rdatools / rdabase

Redistricting analytics data & shared code
MIT License
0 stars 0 forks source link

Convert hard push pass limit to checkpointing the progress every N maps #47

Closed alecramsay closed 4 months ago

alecramsay commented 4 months ago

This would be a nice change. Turns out it would require radical surgery to the code as implemented (I say not 'designed'). Writing a pushed plan happens in the top level script where as the pushing "engine" is several levels down and nows nothing about files of any sort.

The simple thing I could and did do was change the limit from 1,000 to 10,000 passes. Presumably far fewer, if any, pushes will exceed that in the allotted time (20 mins), and we'll get the effect of check pointing every pass in all the instances where the push completes.